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Changing  the  Way  the  United  States 
Measures  Income  and  Poverty:  A  Progress 

Report^ 


This  paper  reports  the  general  resuhs  of 
research  undertaken  by  Census  Bureau 
staff.  The  views  expressed  are  attributable 
to  the  authors  and  do  not  necessarily  reflect 
the  views  of  the  Census  Bureau  or  the  U.S. 
government.  The  authors  would  like  to 
acknowledge  and  thank  the  following 
people  for  their  comments  and 


hv  Daniel 
Cbaiie 


H.  Weinberg  & 
s  T.  Nelson  ' 


suggestions — Nancy  Gordon,  Edward  Welniak  and  the 
coauthors  of  the  other  papers  cited  in  this  report;  they  bear 
no  responsibility  for  any  errors  that  remain. 

I.  BACKGROUND  —  THE  OFFICIAL  DEFINITION 

The  United  States  Census  Bureau  has  been  compiling 
income  estimates  annually  since  1947.  These  estimates  are 
from  the  Current  Population  Survey  (CPS),  a  nationwide 
random  sample  of  households,  whose  primary  purpose  is  to 
collect  labor  force  information  monthly.  In  March  of  each 
year  (April  prior  to  1956),  data  are  collected  on  the 
household's  income  for  the  previous  calendar  year. 

The  official  definition  of  income  is  not  specified  in  law  or 
regulation.  In  effect,  what  is  included  in  income  depends 
on  the  questions  asked.  As  survey  researchers  know,  the 
more  questions  one  asks  about  income  by  source,  the  better 
able  respondents  are  to  identify  all  income.  Initially,  there 
were  only  two  questions  asked  of  each  adult:-  ( I )  "How 
much  did  ...  earn  in  wages  and  salaries  in  1947?"  and  (2) 
"How  much  income  from  all  sources  did  ...  receive  in 
19477"    jn  1949.  self-employment  income  was  asked 
separately  and  in  1950  farm  and  nonfarm  self-employment 
income  was  asked  separately.  In  1962.  the  Census  Bureau 
began  systematically  assigning  values  to  missing  income 
items  (based  on  reported  characteristics  using  the  "hot 
deck"  method).  In  March  1967.  the  number  of  income 
questions  was  again  expanded,  from  four  to  eight 
categories.  These  additional  items  dealt  with  Social 
Security,  interest,  dividends,  and  rent.  In  1968.  interest, 
dividends,  rents,  and  royalties  were  combined  into  one 
question  and  separate  questions  were  added  on  public 
assistance  and  on  unemployment  and  workers' 
compensation.  In  1975.  the  number  of  income  questions 
increased  from  eight  to  eleven  through  addition  of  a 
question  on  the  Supplemental  Security  Income  program,  a 
question  on  Aid  to  Families  with  Dependent  Children  and 
general  assistance,  and  private  and  government  pension 
income.  A  major  change  look  place  in  1980  —  the 


questionnaire  was  expanded  to  identify 
over  50  sources  of  income  and  recording  of 
up  to  27  different  income  amounts, 
including  receipt  of  numerous  noncash 
benefits,  such  as  food  stamps  (coupons 
used  as  cash  for  qualified  food  purchases), 
and  housing  assistance.  Except  for  minor 
wording  changes,  those  questions  are  still 


in  use  today.  The  survey  was  converted  to  a  computer- 
assisted  interviewing  mode  in  1994. 

The  data  on  income  thus  cover  money  income  received 
(exclusive  of  certain  money  receipts  such  as  capital  gains) 
before  payments  for  items  such  as  personal  income  taxes. 
Social  Security  payroll  taxes,  and  union  dues.  Money 
income  does  not  reflect  the  fact  that  some  families  receive 
part  of  their  income  in  the  form  of  noncash  benefits,  such 
as  food  stamps,  health  benefits,  rent-free  or  subsidized 
housing,  and  goods  produced  and  consumed  on  the  farm.  In 
addition,  money  income  does  not  refiect  the  fact  that 
noncash  benefits  are  also  received  by  some  as  fringe 
benefits,  e.g.  the  use  of  company  cars,  and  full  or  partial 
payments  by  business  for  retirement  programs,  medical 
insurance,  and  educational  expenses. 

Moreover,  for  many  different  reasons,  there  is  a  tendency 
in  household  surveys  for  respondents  to  underreporl  their 
income.  From  an  analysis  of  independently  derived  income 
estimates,  it  has  been  determined  that  income  earned  from 
wages  or  salaries  is  much  better  reported  than  other  sources 
of  income  and  is  nearly  equal  to  independent  estimates  of 
aggregate  earnings  (Coder  and  Scoon-Rogers.  1996). 
Among  the  least  well-reported  sources  are  interest  and 
dividends.  The  detailed  components  of  money  income  are 
presented  in  the  Appendix. 

//.  ALTERNATIVE  MEASURES  OF  INCOME 
Because  money  income  is  but  one  measure  of  economic 
well-being,  the  Census  Bureau  also  reports  on  14  other 
definitions  of  income  (the  series  begins  in  1979).    While 
not  exhaustive,  they  do  illustrate  different  perspectives  on 
what  could  be  included. 

Definition  I.  Money  income  excluding  capital  gains 
before  taxes.  This  is  the  official  definition  described 
above. 
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Definition  2.  Definition  1  less  government  cash 
transfers.  Government  cash  transfers  include 
nonmeans-tested  transfers  such  as  Social  Security 
payments,  unemployment  compensation,  and 
government  educational  assistance  (e.g..  Pell  Grants),  as 
well  as  means-tested  transfers  such  as  Aid  to  Families 
with  Dependent  Children  (AFDC).  Temporary 
Assistance  to  Needy  Families,  and  Supplemental 
Security  Income  (SSI). 

Definition  3.  Definition  2  plus  capital  gains.  Realized 
capital  gains  and  losses  are  simulated  as  part  of  the 
Census  Bureau's  Federal  individual  income  tax 
estimation  procedure.  While  the  Census  Bureau  has 
access  to  some  income  information  on  individual  tax 
returns  that  can  he  matched  (with  substantial  time  lag)  to 
survey  data,  actual  capital  gains  or  losses  or  tax  liability 
are  not  known. 

Definition  4.  Definition  3  plus  imputed  health  insurance 
supplements  to  wage  or  salary  income.  Employer-paid 
health  insurance  coverage  is  treated  as  part  of  total 
worker  compensation;  no  other  benefits  paid  for  or 
provided  by  employers  are  estimated. 

Definition  5.  Definition  4  less  payroll  taxes.  Payroll 
taxes  are  payments  for  Social  Security  old  age, 
survivors,  and  disability  insurance,  and  for  hospital 
insurance  (Medicare). 

Definition  6.  Definition  5  less  Federal  income  taxes. 
TTie  effect  of  the  Earned  Income  Tax  Credit,  targeted  to 
low-income  workers,  is  shown  separately  in  Definition 

7. 

Definition  7.  Definition  6  plus  the  Earned  Income  Tax 
Credit. 

Definition  8.  Definition  7  less  state  income  taxes. 

Definition  9.  Definition  8  plus  nonmeans-tested 
government  cash  transfers.  Nonmeans-tested 
government  cash  transfers  include  Social  Security 
payments,  unemployment  compensation,  workers" 
compensation,  nonmeans-tested  veterans"  payments, 
U.S.  railroad  retirement,  Black  lung  payments,  and  Pell 
Grants  and  other  government  educational  assistance. 
(Pell  Grants  are  income-tested  but  are  included  here 
because  they  are  very  different  from  the  assistance 
programs  included  in  the  means-tested  category.) 

Definition  10.  Definition  9  plus  the  value  of  Medicare. 
Medicare  is  counted  at  its  fungible  value.' 

Definition  II.   Definition  10  plus  the  value  of 
regular-price  school  lunches. 


Definition  12.  Definition  1 1  plus  means-tested 
government  cash  transfers.  Means-tested  government 
cash  transfers  include  AFDC.  SSI,  other  public 
assistance  programs,  and  means-tested  veterans" 
payments. 

Definition  13.  Definition  12  plus  the  value  of  Medicaid. 
Medicaid  is  counted  at  its  fungible  value. 

Definition  14.  Definition  1.^  plus  the  value  of  other 
means-tested  government  noncash  transfers.  Including 
food  stamps,  rent  subsidies,  and  free  and  reduced-price 
school  lunches. 

Definition  15.  Definition  14  plus  net  imputed  return  on 
equity  in  one's  own  home.  This  definition  includes  the 
estimated  annual  benefit  of  converting  one"s  home 
equity  into  an  annuity,  net  of  property  taxes. 

Table  12  is  a  reproduction  of  a  table  from  U.S.  Bureau  of 
the  Census  ( 1996a)  illustrating  the  different  distributions  of 
income  that  these  definitions  imply.''  Table  5  (U.S.  Bureau 
of  the  Census,  1996b)  illustrates  this  effect  on  poverty 
estimates. 

These  alternative  definitions  illustrate  the  dilemma  faced 
by  official  statisticians  when  presenting  income  statistics. 
Different  definitions  serve  different  purpo.ses.  Money 
income  has  its  uses  —  it  represents  command  over  the 
resources  available  to  purchase  the  necessities  of  life  in  the 
open  market,  including  meeting  the  obligations  of 
citizenship  (taxes).  Definition  4  probably  comes  closest  to 
measuring  what  resources  would  be  available  in  the 
absence  of  government,  except  that  some  benefits  paid  for 
or  provided  by  employers  are  not  included  and  others  are 
mandated  by  the  government,  some  benefits  are  not 
provided  by  employers  because  they  are  provided  by  the 
government,  and  work  effort  is  presumably  reduced  by  the 
existence  of  a  tax  on  earnings.  Definition  8  is  closest  to 
after-tax  income.  Disposable  income  tries  to  take  account 
of  the  effect  of  taxes  and  transfers  on  the  household"s 
command  of  resources  —  definition  1 4  probably  comes 
closest  to  that  approach.  Finally,  in  definition  15  there  is 
an  attempt  to  include  the  income  equivalent  value  of 
owning  one"s  own  home  in  that  such  an  asset  reduces  the 
need  for  additional  expenditures  on  shelter. 

///.   CONSIDERA  TIONS  IN  MEASURING  POVERTY 
Formal  measurement  of  poverty  in  the  United  States  is  less 
than  three  decades  old.  Not  since  the  adoption  of  official 
poverty  thresholds  by  the  Federal  government  in  the  late 
1960"s  has  there  been  such  a  great  interest  as  now  in 
examining  and  possibly  respecifying  the  thresholds  and  the 
income  compared  with  them.  The  official  poverty 
thresholds  in  use  today  by  the  U.S.  Bureau  of  the  Census  to 
measure  poverty  have  their  basis  in  work  by  Orshansky 


(1963.  1965).  Orshansky  started  with  a  set  of  minimally 
adequate  food  budgets  ealeulated  for  families  of  various 
sizes  and  eomposition  by  the  U.S.  Department  of 
Agrieulture  for  1961.  Based  on  evidence  from  the  1955 
Household  Food  Consumption  Survey,  she  determined  that 
expenditures  on  food  represented  about  one-third  of  after- 
tax income  for  the  typical  family.  This  relationship  yielded 
a  "multiplier"  of  three,  that  is,  the  minimally  adequate  food 
budgets  were  multiplied  by  a  factor  of  three  to  obtain  124 
poverty  thresholds  that  differed  by  family  size,  number  of 
children,  age  and  sex  of  head,  and  farm  or  nonfarm 
residence  (ad  hoc  adjustments  were  made  for  families  of 
size  one  and  two). 

In  1969,  the  U.S.  Bureau  of  the  Budget  (now  the  U.S. 
Office  of  Management  and  Budget  —  OMB)  adopted  the 
Orshansky  measure  using  pre-tax  income  as  the  standard 
government  poverty  measure,  mandating  that  thresholds  be 
adjusted  for  inflation  using  the  Consumer  Price  Index  (CPI) 
published  by  the  U.S.  Bureau  of  Labor  Statistics.  With 
only  minor  modifications  since  then  (mostly  reducing  the 
number  of  categories,  now  48),  the  Orshansky  thresholds 
still  form  the  basis  for  the  official  poverty  statistics.^ 

When  considering  the  adequacy  of  the  official  poverty 
thresholds,  it  is  critical  to  realize  that  one  cannot  separate 
the  issue  of  income  measurement  from  poverty  definition. 
When  one  defines  the  level  of  resources  needed  to  be  non- 
poor,  one  must  also  determine  which  resources  are  to  be 
counted.  Therefore,  the  discussion  below  covers  both 
income  measurement  and  poverty  definition  issues;  income 
measurement  is  discussed  first." 

Whatever  poverty  thresholds  are  chosen  should  be  the 
result  of  a  carefully  specified  process  that  cannot  be 
changed  arbitrarily  from  year-to-year,  and  should  be 
capable  of  being  updated  at  reasonable  intervals  as  the 
economic  circumstances  of  the  society  and  the  behavior  of 
its  demographic  and  economic  components  change. 

A.  DEFINING  INCOME  FOR  MEASURING  POVERTY 
The  key  measurement  issues  are  three  —  valuing  and 
counting  noncash  income,  subtracting  taxes,  and  reducing 
survey  underreporting  and  nonsampling  errors.  Also  of 
interest  is  whether  to  continue  to  publish  official  estimates 
based  on  the  CPS  or  switch  to  a  newer  survey  designed  to 
collect  better  income  information,  the  Survey  of  Income 
and  Program  Participation  (SIPP). 

A.l.    Noncash  income 

The  issue  of  valuing  noncash  income  spans  the  income 
distribution.  A  more  comprehensive  income  measure,  such 
as  definition  14  above,  would  place  a  value  not  only  on 
noncash  government  transfers,  such  as  food  stamps,  which 
typically  go  to  low-income  families,  but  also  on  elements 
of  nonwage  compensation  (from  employer-paid  health 


insurance  to  company  cars)  that  typically  go  to  earners  at 
all  income  levels  or  only  at  high  levels.  The  noncash 
income  of  U.S.  families  has  grown  substantially  in  the  past 
25  years.  In  the  I990"s,  over  half  of  government  transfer 
spending  for  the  poor  is  in  the  form  of  noncash  benefits 
(U.S.  Bureau  of  the  Census,  1996a),  whereas  the  only 
noncash  benefit  program  that  predated  the  1960"s  "War  on 
Poverty"  was  subsidized  (public)  housing.  This  growth  of 
benefits  to  the  poor  has  been  paralleled  by  a  growth  of 
nonwage  compensation  to  wage  earners,  induced  in  part  by 
tax  laws  exempting  such  compensation  from  income  and 
payroll  taxes,  and  by  growth  in  health  benefits  for  the 
elderly.  By  1996,  employer  costs  for  nonwage 
compensation  had  grown  to  over  one-quarter  (28.4  percent) 
of  total  compensation  costs,  up  from  19.4  percent  in  1966.' 
Further,  nearly  two-thirds  of  households  own  homes,  which 
provide  them  with  additional  noncash  income  in  the  form 
of  housing  services. 

Of  key  concern  to  understanding  the  well-being  of  U.S. 
households  is  the  valuation  of  medical  benefits,  both  the 
government  health  programs — Medicare  (medical  aid  to  the 
elderly  and  severely  disabled)  and  Medicaid  (medical  aid  to 
a  portion  of  the  poor) — and  employer-paid  health 
insurance.  The  valuation  of  medical  benefits  is  particularly 
difficult  since  coverage  of  high  medical  expenses  for 
people  who  are  sick  does  nothing  to  improve  their  poverty 
status  (although  the  benefits  clearly  make  them  better  off). 
Even  if  one  imputes  the  value  of  an  equivalent  insurance 
policy  to  program  participants,  these  benefits  (high  in 
market  value  due  to  large  medical  costs  for  the  fraction 
who  do  get  sick),  and  cannot  be  used  by  the  recipients  to 
meet  other  needs  of  daily  living.  Accordingly,  the  Census 
Bureau  developed  a  not-altogether-satisfactory  method, 
termed  fungible  value  (described  in  footnote  2),  to  avoid 
giving  too  high  a  value  of  these  benefits  to  those  toward  the 
low  end  of  the  income  scale.  Note  that  this  is  not  a 
problem  for  countries  with  universal  health  care  systems. 

A. 2.  Disposable  income 

Even  though  Orshansky's  original  calculations  were  based 
on  post-tax  income,  poverty  has  always  been  calculated  for 
the  official  statistics  using  pre-tax  income  because  of  the 
limited  information  collected  on  the  CPS.  After-tax 
income  is  a  better  measure  of  the  ability  to  meet  the  daily 
necessities  of  life  than  is  money  income.  Also  important, 
in  calculating  disposable  income  though,  is  to  address  the 
advisability  of  deducting  work  expenses  for  wage  earners 
such  as  child  care,  uniforms,  and  transportation  costs. 

A. .3,  Other  issues 


As  noted  earlier,  research  matching  household  survey 
responses  to  Federal  income  tax  returns  and  comparing 
them  with  national  income  accounts  has  revealed 
substantial  areas  where  the  level  and  receipt  of  certain 
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income  sources  is  underreported.  Attempts  to  reduce 
underreporting  were  made  hy  revising  the  language  used  in 
the  CPS  questionnaire  (and  using  a  shorter  reference 
period)  when  the  SIPP  was  launched.  This  was  only 
partially  successful,  and  response  errors  remain. 

While  current  procedures  of  the  Census  Bureau  reweight 
the  data  for  full  interview  nonresponse  and  impute 
appropriate  income  responses  for  individual  unanswered 
questions  (item  nonresponse).  these  corrections  are 
insufficient  to  fully  resolve  the  problem.  Procedures  to 
enhance  the  data  through  microsimulation  or  other  means 
are  being  investigated,  along  with  continued  improvement 
in  imputation  for  nonresponse. 

In  most  societies,  "underground."  "nonmarket,"  or  "black 
market"  income  from  legal  or  illegal  activities  is  typically 
poorly  reported  by  household  respondents  to  government 
surveys  (or  not  even  collected)  and  consequently  is 
substantially  omitted  from  official  income  statistics.  This 
income  ranges  from  barter  transactions  to  home  production 
(e.g.,  home  gardens)  to  illegal  income.  Researchers  are  a 
long  way  from  measuring  this  activity  accurately,  however, 
so  including  this  income  in  official  statistics  would  be  quite 
difficult. 

It  has  been  suggested  that  consumption  is  a  better  measure 
of  well-being  than  income  (see  Cutler  and  Katz.  1991.  and 
Slesnick.  1993).  If  a  family  can  maintain  its  consumption 
through  judicious  use  of  assets  when  income  falls,  is  it  truly 
poor?  Unfortunately,  it  is  difficult  to  collect  accurate 
annual  data  on  consumption  or  even  expenditures.  Further, 
consumption  reflects  choices  on  how  to  allocate  resources, 
rather  than  need.  Nevertheless,  fuller  investigation  of  a 
consumption-based  measure  would  be  useful. 

A  final  issue  of  income  measurement  is  the  choice  of 
surveys  to  use.  As  mentioned  briefly  above,  the  SIPP 
questionnaire  design,  as  crafted  to  reduce  income 
underreporting,  does  succeed  for  almost  all  income 
sources."  Yet.  when  compared  with  the  CPS.  it  has 
historically  had  several  drawbacks — a  smaller  sample  size 
(one-third  as  large)  and  necessarily  slower  data  release 
because  of  its  much  greater  complexity.  These  defects  are 
compensated  for  by  the  SIPP  having  greater  income  detail, 
both  in  number  of  sources  and  in  time  segments  (by  having 
monthly  as  opposed  to  the  CPS's  annual  statistics.)  and 
lower  underreporting.  The  new  version  of  the  SIPP.  as 
implemented  in  1996.  increased  the  sample  size 
substantially  (to  36.700  households)  and  oversampled  low- 
income  households.  National  estimates  from  the  SIPP  will 
then  be  comparable  to  or  better  than  (in  terms  of  sampling 
error)  those  from  the  CPS  (reduced  to  48.000  households 
but  inefficient  for  national  estimates  because  it  uses  a  state- 
based  design).  One  drawback  for  obtaining  a  consistent 
time  series  of  annual  national  income  or  poverty  estimates 
from  the  SIPP.  though,  will  be  sample  attrition  and  time-in- 


sample  bias  as  current  plans  call  for  only  one  SIPP  panel  to 
be  in  the  field  during  any  one  four-year  period.  The  CPS 
sample  is  constantly  refreshed  by  new  hou.seholds. 

While  the  timeliness  issue  may  never  be  resolved  fully  in 
SIPP's  favor,  the  SIPP  can  provide  a  preliminary  estimate 
on  much  the  same  schedule  as  the  CPS.  Still,  it  is  desirable 
to  view  the  surveys  complementarily.  If  modeling  using 
administrative  records  can  correct  underreporting  errors  in 
both  surveys,  they  would  then  give  the  same  aggregate 
statistics.  The  CPS  could  be  used  for  a  quick  snapshot, 
consistent  with  data  collected  since  1947  (the  SIPP  began 
in  1983),  while  the  SIPP  would  be  used  for  more  detailed 
estimates,  for  subannual  and  multiyear  estimates,  and  for 
understanding  other  dimensions  of  poverty  (assets, 
disability,  gross  flows,  and  other  dynamic  aspects).** 

B.  SETTING  THRESHOLDS  TO  DEFINE  POVERTY 

With  an  absolute  measure  of  poverty,  there  are  key 
decisions  to  be  made  about  determining  the  appropriate 
level  for  poverty  thresholds.  The  key  research  issues 
addressed  here  are  minimal  consumption  levels  for  specific 
commodities,  ways  of  correcting  for  differences  in  family 
size  and  composition,  and  ways  of  correcting  for  cost-of- 
living  differences  across  time  and  among  areas. 

B.l.  Minimal  consumption  standards 

Minimal  consumption  standards  for  all  necessary 
commodities  could  in  theory  be  established,  perhaps  by  an 
expert  panel,  but  doing  so  would  raise  difficult  ethical 
issues  about  which  commodities  to  include  (e.g.,  is  a 
telephone  a  necessity?).  One  alternative  is  to  define 
minimal  consumption  standards  for  a  limited  number  of 
necessities  (e.g.  food,  clothing,  shelter)  and  obtain  a 
poverty  threshold  by  using  a  multiplier  to  account  for 
necessities  not  measured.'" 

B.2.  Equivalence  scales 

The  relationship  embodied  in  the  current  U.S.  poverty 
thresholds  among  families  of  different  sizes  (termed  the 
equivalence  scale)  is  supposed  to  represent  the  different 
relative  costs  of  supporting  those  families  at  a  minimally 
adequate  levels.  In  fact,  the  relationship  is  based  solely  on 
the  relative  food  costs  as  they  existed  in  1961  and  include 
some  unfortunate  anomalies  (see  Ruggles,  1990.  pp.  64- 
68).  While  it  is  possible  to  develop  minimal  budgets  for 
every  type  and  size  of  family  separately  and  thus  eliminate 
the  need  for  equivalence  scales  entirely,  in  practice  it  is 
difficult  to  do  so.  No  one  scale  now  exists  that  is  generally 
accepted.  Issues  in  developing  equivalence  scales  include 
which  distinctions  in  family  circumstances  (e.g.  owner/ 
renter)  should  lead  to  different  thresholds,  how  resources 
are  shared  within  the  family  or  household,  and  whether  a 
more  useful  basis  for  determining  poverty  is  the  household 
(those  living  in  one  housing  unit)  rather  than  the  familv 


(those  in  one  household  related  by  blood  or  marriage).  See 
Betson  (1996)  for  a  further  discussion  of  these  issues. 

B.3.  Cost-of-living  differences 

In  as  large  and  diverse  a  country  as  the  U.S.,  there  are 
significant  differences  in  the  cost  of  living  among 
localities.  Unfortunately,  there  are  no  currently  available 
data  upon  which  to  estimate  interarea  price  differences 
reliably.  (See  Kokoski  et  al.,  1992,  and  Moulton,  1992,  for 
some  work  in  this  area.) 

A  related  price  issue  is  how  to  adjust  for  inflation.  TTie 
U.S.  poverty  thresholds  now  use  the  CPI  to  adjust 
thresholds  over  time.  If  the  measurement  of  minimal 
consumption  is  used  as  the  basis  for  new  thresholds, 
presumably  this  should  be  the  basis  every  year,  with 
components,  prices,  and  multipliers  reestimated  as  often. 
Clearly  this  is  not  practical.  A  reasonable  compromise 
might  be  to  respecify  and  reestimate  the  minimal 
consumption  bundle  at  prespecified  intervals  as  market 
baskets  become  outdated,  say  every  ten  years,  and  use  the 
CPI  for  interim  adjustments.  The  market  basket  used  for 
the  CPI  itself  is  typically  reviewed  and  respecified  once 
every  ten  years  or  so." 

C.  THE  COMMITTEE  ON  NA  TIONAL  STA  TISTICS 
REPORT 

The  National  Academy  of  Sciences'  Committee  on 
National  Statistics  (CNStat)  released  a  report  in  May  1995 
entitled  Measuring  Poverty:  A  New  Approach  (Citro  and 
Michael,  1995).  In  that  report,  the  committee 
recommended  that  the  Federal  government  redefine  the 
way  it  measures  poverty.  OMB  has  requested  that  experts 
from  the  Census  Bureau  and  other  agencies  examine 
technical  methods  for  doing  so. 

The  key  changes  they  recommend  are  threefold:  change 
the  income  measure,  change  the  poverty  thresholds,  and 
change  the  survey  used.  To  change  the  income  measure 
from  the  current  money  income  definition,  they  propose  to 
add  noncash  benefits,  subtract  taxes,  subtract  work 
expenses,  subtract  child  care  expenses,  subtract  child 
support  paid,  and  subtract  medical  out-of-pocket  expenses 
(MOOP).  The  poverty  thresholds  are  to  be  based  on  food, 
clothing,  shelter,  and  "a  little  bit  more"  (75-83%  of  median 
expenditures  on  these  items  multiplied  by  1.15-1.25),  a  new 
equivalence  scale,  an  allowance  for  geographic  variation, 
and  are  to  be  updated  annually  based  on  growth  in  median 
expenditures.  Finally,  the  panel  recommended  that  the 
government  use  the  SIPP  instead  of  the  March  CPS  to 
collect  the  basic  income  and  poverty-related  data. 

Among  the  technical  issues  to  be  resolved  before 
implementing  such  a  new  measure  are  the  following: 

1.  Reestimating  the  valuation  metht)dolosies  for 


government  noncash  transfer  programs  including  school 
lunches,  food  stamps,  and  housing  benefits;  developing 
new  estimation  methodologies  for  additional  programs 
and  possibly  developing  a  new  methodology  for  valuing 
Medicare  and  Medicaid  (depending  on  whether  the 
subtraction  of  MOtJP  is  adopted  or  not); 

2.  Completing  development  of  a  tax  simulation  model  for 
SIPP; 

3.  Developing  a  metht^dology  for  estimating  MOOP  (e.g. 
a  statistical  match  of  the  National  Medical  Expenditures 
Survey  to  SIPP)  or  reestimation  of  employer  contributions 
to  health  insurance  using  more  recent  data; 

4.  Estimating  and  imputing  work  and  child  care  expenses; 

5.  Redesigning  the  SIPP  sampling  scheme  to  maximize 
reliability  of  a  time  series  of  cross-section  estimates  while 
maintaining  some  longitudinal  estimation  capabilities, 
taking  account  of  the  need  for  state-level  estimates,  and 
minimizing  the  attrition  bias; 

6.  Reviewing  the  Consumer  Expenditure  Survey  to 
improve  its  effectiveness  for  its  new  dual  role  (defining 
the  market  basket  for  the  Consumer  Price  Index  and  the 
poverty  thresholds)  and  possibly  preparing  for 
consumption-based  rather  than  income-based  poverty 
estiinates  in  the  future; 

7.  Creating  a  time  series  of  poverty  estimates  from  the 
SIPP  and  developing  methods  to  impute  additional 
variables  to  the  CPS  to  develop  comparable  time-series 
data  for  that  survey; 

8.  Doing  substantial  further  work  on  income 
underreporting  and  imputation  models; 

9.  Adding  child  support  and  alimony  paid  questions  to 
CPS;  and 

10.  Developing  and  adding  "medical  care  risk"  and 
possibly  medical  expenditures  questions  to  SIPP  to 
supplement  the  poverty  measure  if  medical  care  costs  and 
benefits  are  excluded  from  the  measure. 

Even  if  these  technical  issues  can  be  resolved 
expeditiously,  there  are  still  policy  issues  that  must  be 
debated  and  resolved  before  a  new  measure  is  adopted. 
These  include: 

/.  Including  or  excluding  medical  costs  cmd  benefits. 
On  the  one  hand,  the  CNStat  recommended  excluding 
MOOP.  employer  contributions  to  health  insurance,  and 
benefits  from  medical  transfer  programs  from  income. 
On  the  other  hand,  adopting  as  official  the  current 
(experimental)  practice  of  including  them  would  require 
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improving  the  current  method  for  valuing  medical 
transfer  program  benefits,  measuring  medical  needs 
more  accurately,  and  updating  the  methodology  for 
imputing  employer  contributions  to  health  insurance. 

2.  Basing  thresholds  on  a  pre-specified  fraction  of 
median  expenditures.   How  might  the  public  and 
Congress  react  to  a  new  poverty  threshold  that  showed 
millions  more  poor  persons  than  the  current  measure? 
Are  we  confident  enough  about  the  quality  of  (i.e.  lack 
of  biases  in)  the  Consumer  Expenditure  Survey  data  to 
use  it  as  the  arbiter  of  the  poverty  level?  It  may  be  that 
the  likely  acceptance  of  any  new  definition  would  be 
enhanced  if  the  new  index  were  "chained'"  to  the  old  by 
matching  the  overall  poverty  rate  obtained  (but  allowing 
the  distribution  to  vary). 

3.  Developing  geographical  cost-of-living  variations.   It 
is  clear  that  the  cost  of  living  differs  substantially  from 
place  to  place,  and  different  choices  of  methodology  to 
reflect  this  fact  would  have  different  implications.  If 
geographic  variation  is  to  be  incorporated,  some  method 
for  periodically  updating  the  thresholds  for  relative  price 
changes  among  areas  would  also  need  to  be  established. 

4.  Annual  inflation  updating.    The  panel  proposed  using 
the  rate  of  growth  in  expenditures  to  index  the 
thresholds.  This  is  an  attempt  to  introduce  some 
deliberate  "relativity"  into  the  measure  and  would  have 
quite  different  ramifications  from  using  the  Consumer 
Price  Index. 

5.  Choosing  the  equivalence  scale.  Choice  of  the  scale 
would  inevitably  alter  the  distribution  of  the  poor. 

6.  Underreporting.  If  the  technical  issues  about  how  to 
do  so  are  resolved,  .vhould  the  income  statistics  from  the 
survey  be  adjusted  for  underreporting  based  on 
administrative  data  and  modeling? 

7.  Review  and  Revision.  Should  any  new  definition 
include  a  regular  cycle  of  review  and  revision  based  on 
pre-specified  criteria  (CNStat  recommended  once  a 
decade)? 

Open  debate  of  these  issues  seems  the  most  likely  way  to 
resolve  them,  potentially  leading  to  a  new  way  of 
measuring  poverty  that  OMB  would  approve  and  that  other 
policy  makers  would  accept  as  an  improved  methodology 
for  measuring  poverty  in  the  United  States. 

D.  CENSUS  BUREA  U  POVERTY  REDEFINITION 
RESEARCH 

In  order  to  provide  a  basis  on  which  some  of  these  issues 
can  be  resolved,  the  Census  Bureau  and  other  U.S. 
government  agencies  have  begun  research  studies. 


D.I.  Census  Bureau-Bureau  of  Labor  Statistics  Studx 
The  CNStat  report  on  redefining  poverty  contained 
sweeping  recommendations  for  changing  the  way  poverty 
is  defined  in  the  U.S.    Recent  joint  research  by  the  Bureau 
of  the  Census  and  the  Bureau  of  Labor  Statistics  (BLS) 
(Garner  et  al..  1997)  examined  two  of  these  issues  — 
changing  the  income  definition  and  modifying  the  poverty 
thresholds. 

In  formulating  poverty  thresholds,  BLS  researchers  started 
by  implementing  the  basic  recommendations  from  the 
CNStat  report.  Some  of  the  CNStat  panel 
recommendations  regarding  thresholds  were  given  as 
ranges.  Thus,  some  simplifying  assumptions  were  made. 
First,  the  panel  recommended  a  range  of  thresholds,  with  a 
lower  bound  based  on  78  percent  of  median  expenditures 
for  food,  clothing,  and  shelter  and  a  multiplier  of  1 . 1 5  to 
account  for  other  needs.  The  upper  bound  was  based  on  83 
percent  of  the  median  and  a  multiplier  of  1 .25.  In  the 
Gamer  et  al.  paper  the  midpoint  of  this  range  was  used. 
The  other  simplifying  assumption  was  for  the  equivalence 
scale  (the  relationship  between  thresholds  for  different 
family  sizes).  The  panel  recommended  a  range  of  economy 
scale  factors  of  0.65  to  0.75  and  again  they  choose  the 
midpoint  —  0.70.  Thresholds  were  computed  for  the  years 
1990  through  1995. 

On  the  resource  side,  the  panel's  recommendations  were 
followed  to  the  extent  possible.  The  only  recommendation 
not  followed  (because  of  a  lack  of  data)  was  their 
recommendation  to  subtract  child  support  paid  from 
income  when  computing  a  poverty  resource  measure. 
Though  the  panel  recommended  changing  the  official 
source  of  poverty  statistics  in  the  U.S.  from  the  CPS  to  the 
SIPP,  the  initial  work  was  based  on  the  CPS.  At  this  time, 
the  CPS  is  the  only  survey  with  a  working  tax  simulation 
model  and  in-kind  benefit  valuation  procedures,  both 
necessary  ingredients  for  producing  a  resource  measure 
based  on  the  panel's  recommendations. 

The  report  found  that  the  threshold  computation  methods  as 
recommended  by  the  panel  result  in  relatively  stable 
thresholds  over  time  (at  least  over  the  1990-1995  period 
measured  in  this  study),  and  the  resulting  poverty  rates 
based  on  applying  the  panel's  basic  resource  definition  to 
these  thresholds  also  showed  relatively  stable  results.  In 
fact,  though  the  panel's  recommendations  result  in 
significantly  higher  poverty  rates  than  the  U.S.  official 
estimates,  the  trends  based  on  the  official  estimates  and  the 
panel's  recommended  method  show  very  similar  trends 
overthe  1990-1995  period  (see  Figure  I).  Differences 
across  subgroups  were  also  found  to  be  stable  over  time. 
However,  the  key  change  under  the  proposed  definition  of 
poverty  is  in  the  composition  of  the  poverty  population. 
Consistent  with  the  panel's  findings,  poverty  rates  under 
the  recommended  poverty  measure  are  significantly  higher 
among  groups  with  relatively  low  official  poverty  rates  (for 


example.  Whites  or  those  living  in  married-couple 
families).  Groups  with  relatively  high  poverty  rates,  on  the 
other  hand,  did  not  tend  to  have  very  different  poverty  rales 
under  the  revised  measure.  Thus,  an  effect  of  moving  to  the 
recommended  poverty  measure  would  be  to  narrow  the 
gaps  that  now  exist  in  the  U.  .S.  between  high-  and  low- 
poverty  groups  (married-couple  and  single-parent  families. 
Whites  and  Blacks,  etc.).  Put  another  way.  under  the 
revised  measure,  the  poverty  population  looks  more  like  the 
total  population  in  terms  of  demographic  and 
socioeconomic  characteristics.  (See  Table  1  and  Figures  2- 
4.) 

Other,  slightly  different  poverty  thresholds  were  also 
examined  in  the  Census-BLS  study.  One  modification, 
which  was  suggested  by  the  panel,  was  to  define  shelter 
costs  by  their  rental  equivalent  value.  This  technique 
resulted  in  higher  poverty  thresholds  (and  higher  poverty 
rates),  and  appeared  to  have  some  effect  on  the  composition 
of  the  poverty  population  (further  narrowing  the  gaps,  for 
example,  between  high-and  low-poverty  groups).  Another 
set  of  thresholds  was  based  on  alternative  multipliers  that 
were  computed  more  precisely  than  those  used  in  the 
Panel's  report.  This  modification  resulted  in  little  change 
in  the  composition  of  the  poverty  population. 

D.2.  Oilier  Census  Bitieau  Poverty  Research 
The  panel  recommended  changing  the  source  of  olficial 
U.S.  poverty  estimates  from  the  March  CPS  to  the  SIPP. 
As  noted  earlier,  the  SIPP  is  a  longitudinal  survey  with:  1 ) 
a  more  detailed  set  of  questions  than  the  CPS,  2)  a  shorter 
reference  period  (4  months  versus  12  months  for  the  CPS), 
and  3)  increased  flexibility  sufficient  to  add  the  questions 
required  to  measure  poverty  based  on  the  broadened 
resource  definition  recommended  by  the  panel.  Questions 
have  already  been  added  to  SIPP  to  collect  some  of  this 
additional  informatit)n.  and  a  sample  design  change,  in 
order  to  make  SIPP  a  better  cross-sectional  survey  (a 
requirement  for  measuring  annual  poverty  changes)  has 
been  proposed,  though  not  yet  adopted. 

The  Census  Bureau  has  also  examined  the  panel's 
recommendations  on  work-related  and  child-  care  expenses 
(the  panel  recommended  subtracting  these  costs  from 
income  when  computing  the  poverty  resource  measure  and 
has  suggested  alternative  methods  for  imputing  such  costs). 
This  research  showed  that  using  a  definition  of  resources 
that  excludes  child  care  and  other  work-related  expenses 
has  a  significant  effect  on  poverty  rates.  In  both  CPS  and 
SIPP-based  analyses,  the  effect  of  using  a  resource 
definition  that  excluded  these  expenses  was  to  raise 
children's  poverty  rates  by  about  3  percentage  points.  (Sec 
Short  etal.,  1996.) 

Another  area  of  research  at  the  Census  Bureau  is  on  the 
housing  subsidy  valuation  method.  The  value  of  public  or 
subsidized  housing  is  included  in  the  recommended  poverty 


measure,  and  the  current  Census  Bureau  method  for 
imputing  such  subsidies  (on  the  CPS)  is  badly  outdated. 
Current  methods  are  being  reviewed,  and  ways  to 
miplcmenl  this  imputation  on  SIPP  are  being  explored.  A 
paper  is  planned  for  presentation  in  August  (Eller  and 
Naifeh.  forthcoming). 

The  one  major  element  of  the  panel's  recommended 
resource  measure  not  included  in  the  Census  Bureau-BLS 
study  was  the  subtraction  of  child  support  paid,  since  this 
information  was  not  available  in  the  CPS.  Data  from  SIPP 
indicate  that  the  inclusion  of  such  payments  would  increase 
the  poverty  rate  by  0.3  to  0.5.  Questions  were  added  to  the 
April  1996  CPS  Supplement  on  child  support  to  examine 
the  feasibility  of  capturing  this  information  on  a  regular 
basis  on  the  March  CPS.  Data  on  child  support  paid  are 
regularly  collected  on  SIPP. 

As  already  noted,  the  treatment  of  medical  benefits  and 
expenditures  in  defining  poverty  is  a  difficult  one.  Staff  are 
currently  examining  the  treatment  of  medical  out-of-pocket 
expenditures  in  the  definition  of  poverty  (see  Doyle. 
forthcoming(a)).  To  come  up  with  a  definition  of  income 
that  excludes  these  expenditures,  our  current  thinking  is 
that  statistically  matching  SIPP  to  another  Federal 
government  survey  that  includes  detailed  information  about 
these  expenditures  (the  Medical  Expenditure  Panel  Survey) 
holds  the  most  promise.  In  addition,  staff  are  working  on  a 
proposed  medical  care  risk  index  to  complement  the  new 
poverty  measure  (to  address  another  recommendation  of 
the  panel).  (See  Doyle,  forthcoming(b).) 

Since  the  panel  recommended  an  after-tax  income 
definition  for  its  poverty  measure,  one  problem  with 
transferring  the  official  poverty  measure  from  the  CPS  to 
SIPP  is  the  lack  of  a  working  tax  simulation  model  based 
on  the  SIPP  (since  the  early  1980's,  the  CPS  has  employed 
a  model  to  estimates  taxes).  The  Census  Bureau,  along 
with  several  other  Federal  agencies,  supported  the 
development  of  a  SIPP-based  tax  model,  and  we  are  now  in 
the  process  of  exploring  how  to  best  incorporate  this  model 
into  the  Census  Bureau's  processing  system. 

Equivalence  scales  are  an  important  issue  in  the 
formulation  of  poverty  thresholds.  Betson  ( 1996)  provides 
compelling  evidence  that  the  choice  of  equivalence  scales 
has  a  significant  effect  on  the  composition  of  the  poverty 
population.  He  also  pointed  to  the  need  for  continued 
research  in  this  area. 

In  another  paper.  Betson  ( 1995)  examined  the  issue  of 
home  ownership  and  whether  the  tlow  of  housing  services 
from  owner-occupied  homes  should  be  taken  into  account 
when  defining  poverty  status.  He  found  that  counting  the 
value  of  housing  services  would  change  the  distribution  of 
the  poor,  primarily  by  counting  fewer  of  the  elderly  as 
poor. 
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Table  5.   Poverty  Rates: 
Family  Type  and  Age:  1992 


Official  and  Experimental  by  Race,  Hispanic  Origin, 


Official 

Experimental 

Percent  Difference 

All  Persons 

14  .8 

19  .9 

34  .5 

White 

11.9 

17.1 

43  .7 

Black 

33  .4 

37.1 

11.1 

Hispanic  Origin 
(of  any  race) 

29  .6 

41  .  5 

40.2 

Married  Couple 

7.7 

13  .7 

77.9 

Female  Household 

3  9.0 

4  2  .  8 

9.7 

Under  18  Years  Old 

22  .4 

27.1 

21.0 

18  -  64  Years  Old 

11  .9 

16.3 

37  .0 

65  Years  Old  and  Over 

12.9 

22  .5 

74  .  4 

E.   CONCLUDING  REMARKS 
We  believe  that  prospects  for  developing  a  consensus 
around  a  new  measure  of  poverty  in  the  United  States  are 
the  highest  since  the  current  measure  was  adopted  in  the 
1960"s.  Converting  the  measure  to  the  SIPP  is  not  costless, 
though,  and  budgetary  pressures  may  cause  a  delay  even  if 
a  broad  methodological  consensus  is  reached. 
Furthennore,  delicate  negotiations  over  hroad  policy  issues 
must  ensue  before  any  change  is  made. 

Readers  are  welcome  to  follow  further  developments  as 
they  happen.  Visit  the  special  poverty  measurement  web 
site  at  http://www.census.gov/hhes/www/povmeas.html. 


APPENDIX:  DEFINITION  OF  MONEY  INCOME 

The  current  official  U.S.  definition  of  income  is  based  on 
questions  which  are  asked  of  each  person  in  the  CPS 
sample  household  15  years  old  and  over.'-  These  questions 
cover  the  amount  of  money  income  received  in  the 
preceding  calendar  year  from  each  of  the  following 
sources. 


Earnings  from  longest  job  {or  self-employment)  and  other 
employment  earnings  can  be  classified  into  three  types:  ( 1 ) 
Money  wage  or  salary  income  is  the  total  received  for  work 
performed  as  an  employee  during  the  income  year.  This 
category  includes  wages,  salary.  Armed  Forces  pay, 
commissions,  tips,  piece-rate  payments,  and  cash  bonuses 
earned,  before  deductions  were  made  for  items  such  as 
taxes,  bonds,  pensions,  and  union  dues;  (2)  Net  income 
from  nonfarm  self-employment  is  the  net  money  income 
(gross  receipts  minus  expenses)  from  one's  own  business, 
professional  enterprise,  or  partnership.  Gross  receipts 
include  the  value  of  all  goods  sold  and  services  rendered. 
Expenses  include  items  such  as  costs  of  goods  purchased, 
rent,  heat,  light,  power,  depreciation  charges,  wages  and 
salaries  paid,  business  taxes  (not  personal  income  taxes);" 
and  (.^)  Net  income  from  farm  self-employment  is  the  net 
money  income  (gross  receipts  minus  operating  expenses) 
from  the  operation  of  a  farm  by  a  person  on  their  own 
account,  as  an  owner,  renter,  or  sharecropper.  Gross 
receipts  include  the  value  of  all  products  sold,  payments 
from  government  farm  programs,  money  received  from  the 
rental  of  farm  equipment  to  others,  rent  received  from  fami 
property  if  payment  is  made  based  on  a  percent  of  crops 
produced  and  incidental  receipts  from  the  sale  of  items 
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Figure  1.  Poverty  Rates:  Official  and  Experimental:  1990-1995 
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such  as  wood,  sand,  and  gravel.  Operating  expenses  include 
items  such  as  the  cost  of  feed,  fertiUzer.  seed,  and  other 
farming  supplies;  cash  wages  paid  to  farmhands; 
depreciation  charges;  cash  rent;  interest  on  farm  mortgages; 
farm  building  repairs;  and  farm  taxes  (not  state  and  Federal 
personal  income  taxes).  The  value  of  fuel, 
food,  or  other  farm  products  used  for  family 
living  is  not  included  as  part  of  net 
income. '■* 

Unemployment  compensation  includes 
payments  received  from  government 
unemployment  agencies  or  private 
companies  during  periods  of  unemployment 
and  any  strike  benefits  received  from  union 
funds. 


Workers'  compensation  includes  payinents 
received  periodically  from  public  or  private 
insurance  companies  for  injuries  received  at 
work. 

Social  Security  includes  Social  Security  (old 
age)  pensions  and  survivors"  benefits  and 
pcmiancnt  disability  insurance  payments 


made  by  the  Social  Security  Administration  prior  to 
deductions  for  medical  insurance.  Medicare 
reimbursements  for  health  services  are  not  included. 

Supplemental  Seciirit}'  Income  includes  payments  made  by 
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Federal,  state,  and  local  welfare  agencies  to  low  income 
persons  who  are  65  years  old  or  over,  blind,  or  disabled. 

Public  assistance  or  welfare  payments  include  public 
assistance  payments  made  to  low-income  persons,  such  as 
Aid  to  Families  With  Dependent  Children,  Temporary 
Assistance  for  Needy  Families,  and  general  assistance. 

Veterans'  payments  include  payments  made  periodically  by 
the  Department  of  Veterans  Affairs  to  disabled  members  of 
the  Armed  Forces  or  to  survivors  of  deceased  veterans  for 
education  and  on-the-job  training,  and  means-tested 
assistance  to  veterans. 

Sur\ivor  benefits  include  payments  from  survivors"  or 

widows'  pensions,  estates,  trusts,  annuities,  or  any  other 

types  of  survivor  benefits.  Payments  can  be  reported  from 

ten  different  sources:  private  companies  or  unions;  Federal 

government  (Civil  Service);  military;  state  or 

local  governments;  railroad  retirement;  I 

workers'  compensation;  "Black  lung"  9Ure  4 

(miners')  payments;  estates  and  trusts; 

annuities  or  paid-up  insurance  policies;  and 

other  survivor  payments. 


Disability  benefits  include  payments  received 
as  a  result  of  a  health  problem  or  disability 
other  than  those  from  Social  Security. 
Payments  can  be  reported  from  ten  sources: 
workers'  compensation;  companies  or  unions; 
Federal  government  (Civil  Service);  military; 
state  or  local  governments;  railroad 
retirement;  accident  or  disability  insurance; 
Black  lung  payments;  state  temporary 
sickness;  or  other  disability  payments. 

Pension  or  retirement  income  includes 
payments  reported  from  eight  sources: 


companies  or  unions;  Federal  government 
(Civil  Service);  military;  state  or  local 
governments;  railroad  retirement;  annuities 
or  paid-up  insurance  policies;  withdrawals 
from  special  (tax-favored)  retirement 
accounts  such  as  Individual  Retirement 
Account  (IRA's):  or  other  retirement 
income. 

Interest  income  includes  payments  received 
(or  credited  to  bank  accounts),  from  bonds, 
treasury  notes.  IRA's,  certificates  of  deposit, 
interest-bearing  savings  and  checking 
accounts,  and  all  other  investments  that  pay 
interest. 

Dividends  include  income  received  from 
stock  holdings  and  mutual  fund  shares. 
Capital  gains  from  the  sale  of  stock  holdings 
are  not  included  as  income. 


Rents,  royalties,  and  estates  and  trusts  include  the  net 
income  from  the  rental  of  a  house,  store,  or  other  property, 
receipts  from  boarders  or  lodgers,  net  royalty  income,  and 
periodic  payments  from  estate  or  trust  funds. 

Educational  assistance  includes  Pell  Grants;  other 
government  educational  assistance;  any  scholarships  or 
grants;  or  financial  assistance  from  employers,  friends,  or 
relatives  not  residing  in  the  student's  household. 

Child  support  includes  all  periodic  payments  made  by 
parents  for  the  support  of  children,  even  if  these  payments 
are  made  through  a  state  or  local  government  office.'' 

Alimony  includes  all  periodic  payments  to  ex-spouses. 
One-time  property  settlements  are  not  included. 
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Financial  assistance  from  outside  of  the  household  includes 
periodic  payments  from  nonhousehold  members.  Gifts  or 
sporadic  assistance  is  not  included. 

Other  income  includes  all  other  regularly  received 
payments  that  are  not  included  elsewhere  on  the 
questionnaire.  Some  examples  are  state  programs  such  as 
foster  child  payments,  military  family  allotments,  and 
income  received  from  foreign  government  pensions. 

Receipts  not  counted  as  income  include  capital  gains 
received  (or  losses  incurred)  from  the  sale  of  property, 
including  stocks,  bonds,  a  house,  or  a  car  (unless  the  person 
was  engaged  in  the  business  of  selling  such  property,  in 
which  case  the  net  proceeds  would  be  counted  as  income 
from  self-employment);  withdrawals  of  bank  deposits; 
money  borrowed;  tax  refunds;  gifts;  and  lump-sum 
inheritances  or  insurance  payments. 
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VALUATION  OF  NONCASH  BENEFITS 

Table  12.    Income  Distribution  Measures  by  Definition  of  Income:  1995 

{Numbers  in  thousands    Households  as  of  March  of  the  following  year.  For  meaning  of  symbols,  see  text) 


Excluding 

capital 

gains 

(current 

official 

measure) 


Definition  1 

less 

government 


Definition  2 

plus 

capital 

gains 

(losses) 


Definition  3 

plus 

health 

insurance 

upplements 


to  V 


3  or 


Definition  4 

less 

Social 

Security 

payroll 

taxes 


Definition  5 

less 

Federal 

income 

taxes 


IVLL  HOUSEHOLDS 


Total  

Recipiency  Status 

rt/ith  income  as  defined 

Vith  addition  or  deduction 

Mean  addition  or  deduction dollars. 

Standard  error dollars. 

Mean  total  income  ddllars. 

Standard  error dollars . 

ncome  Levels 

Percent 

Inder  $5.000 

5,000  to  $9,999 

10,000  to  S14,999 

15.000  to  $19,999 

20.000  to  524,999 

26.000  to  $29,999 

30,000  to  $34,999 

35.000  to  $39,999 

40.000  to  $44,999 

45.000  to  $49,999 

50,000  10  $59,999 

60.000  10  $74,999 

75.000  to  $99,999 

100,000  and  over 

nummary  Measures 

ledian dollars. , 

Standard  error dollars. 

lean dollars. , 

Standard  error dollars. , 

ini  ratio 

Standard  error 


99  032 
(X) 
(X) 
(X) 
(X) 
(X) 


I  032 
(X) 
(X) 
(X) 
(X) 
(X) 


93  004 
42  392 
8  879 


93  009 
15  918 
8  512 


93  009 
54  312 
3  897 


44  644 
286 
.509 
0039 


93  014 
73  158 
7  719 


luintile  l^leasures 


owest  quintile: 

Upper  limit dollars. 

Percent  of  households 

With  type  of  addition  or  deduction 

Mean  amount dollars. 

Standard  error dollars . 

3C0nd  quintile 

Upper  limit dollars. 

Percent  of  households 

With  type  of  addition  or  deduction 

Mean  amount dollars. 

Standard  error dollars. 

lird  quintile: 

Upper  limit dollars. 

Percent  of  households 

With  type  of  addition  or  deduction 

Mean  amount dollars. 

Standard  error dollars. 

urih  quintile: 

Upper  limit dollars. 

Percent  of  households 

With  type  of  addition  or  deduction 

Mean  amount dollars. 

Standard  error dollars . 

th  quintile 

Percent  of  households 

With  type  of  deduction 

Mean  amount dollars . 

Standard  error dollars . 


14  420 
20.0 
(X) 
(X) 
(X) 


26  966 
200 


42  012 
20.0 
(X) 


65  258 
20  0 
(X) 
(X) 


35  288 

200 
(X) 


52  481 
20.0 
(X) 
(X) 


200 
(X) 
(X) 
(X) 


35  397 

20.0 

(X) 


200 
(X) 
(X) 
(X) 


7  654 

20.0 

17  144 

9  666 


22  950 

200 

10  031 

9  354 


39  659 

20  0 

6  685 


63  123 

20,0 

4  774 


200 
3  758 
8  073 


7  679 
20  0 
697 


23  086 
200 
1   653 


63  970 

20.0 

3  575 

2  310 


200 
7  505 
16  371 


24  400 

200 

6  299 

2  054 


42  235 

20,0 
13  412 
2  807 


67  767 

200 

16  710 

3  877 


20.0 
17  479 
5  477 


7  410 

200 

4  814 


22  891 

200 

15   137 


39  619 

200 

17  691 

2  292 


63  639 

20.0 

18  532 

3  566 


20,0 
18  923 
5  997 


7  351 
20,0 
423 


21   450 

20.0 

13  583 

1   017 


36  021 

200 

19  353 

2  528 


56  502 

20,0 

19  909 


200 

19  890 

20  037 
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Income  Distribution  Measures  by  Definition  of  Income:  1995-Con. 


Table  12. 

(Numbers  in  thousands    Households  as  of  March  of  Ihe  following  year    For  meaning  of  symbols,  see  lexl) 


Characteristic 


ALL  HOUSEHOLDS 

Total  

Recipiency  Status 

Wilh  income  as  defined 

With  addition  or  deduction 

Mean  addition  or  deduction dollars. 

Standard  error dollars. 

Mean  total  income  dollars. 

Standard  error dollars. 

Income  Levels 

Percent 

Under  $5,000 

$6,000  to  $9,999 

$10,000  10  $1 4,999 

S15.000  to  $1 9,999 

$20,000  to  $24,999 

$25,000  to  $29.999 

$30,000  to  $34.999 

$35,000  to  $39,999 

$40,000  to  $44,999 

$45,000  to  $49,999 

$50,000  to  $59,999 

S60.000  to  $74,999 

$75,000  to  $99.999 

$100,000  and  over 

Summary  Measures 

Median  dollars. 

Standard  error dollars. 

Mean dollars. 

Standard  error dollars. 

Gini  ratio 

Standard  error 

Quintile  Measures 

Lowest  quintile 

Upper  limit dollars. 

Percent  of  households 

With  type  of  addition  or  deduction 

Mean  amount dollars . 

Standard  error dollars. 

Second  quinlile: 

Upper  limit dollars. 

Percent  ot  households 

With  type  of  addition  or  deduction 

Mean  amount dollars . 

Standard  error dollars. 

Third  quintile 

Upper  limit dollars. 

Percent  of  households 

With  type  ot  addition  or  deduction 

Mean  amount dollars. 

Standard  error dollars. 

Fourth  quintile 

Upper  limit dollars. 

Percent  ot  households 

Wilh  type  of  addition  or  deduction 

Mean  amount dollars. 

Standard  error dollars. 

Fifth  quintile 

Percent  ot  households 

With  type  of  deduction 

Mean  amount dollars 

Standard  error dollars 


Definition  7 

less 

State 

income 

taxes 


93  022 
64  827 
2  296 


27  772 

163 

35  262 


7  700 

200 

2  323 


21  354 

200 

13  247 


35  008 

200 

15  857 

1  014 


54  274 

20  0 

16  649 

1  960 


20  0 
16  751 
5  657 


Definition  8 

plus 

nonmeans- 

tested 

government 


13  785 

20.0 

10  441 

6  802 


24  967 

200 

9  233 

9  588 


37  682 

20  0 

7  446 

9  584 


20  0 
4  839 
10  563 


Definition  9 

plus 

medicare 


97  629 
23  259 
5  004 


Definition  10 

plus 

regular-price 


15  382 

200 

4  785 

2  015 


26  564 

20  0 

6  282 

4  630 


38  937 
20  0 

5  238 

6  259 


56  986 

20  0 

3  845 

6  486 


20  0 
3  108 
6  412 


means-tested 
government 


38  950 

20  0 

2  528 


57  002 

20  0 

3  953 


99  041 
8  306 
4  690 


15  855 

200 

4  823 

4  161 


26  837 

200 

1  536 

4  994 


39  096 

20  0 

1  000 

5  268 

259 


Definition  12 

plus 

medicaid 


99  041 
10  207 
2  796 


16  219 

20  0 

2  776 

1   222 


27   195 

20  0 

2  875 

2  703 


39  410 
20  0 

2  009 

3  620 


57  330 

20  0 

1   397 

4  015 


99  224 

16  750 
1   876 


16  758 

20.0 

7  014 

2  244 


27  429 

20  0 

4  439 

1   72 


39  537 

200 

2  624 

1   447 


67  363 
200 
1    301 


Noncash 

transfers 

less  medical 

programs 


99  224 
30  101 
4  816 


25  434 

20  0 

8  870 

5  099 


56  239 

20  0 

3  900 

5  912 


20  0 
3  141 
5  872 
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VALUATION  OF  NONCASH  BENEFITS 


Table  12.    Income  Distribution  Measures  by  Definition  of  Income:  1995-Con. 

(Numbers  in  thousands    Households  as  of  March  of  the  following  year.  For  meaning  of  symbols,  see  text) 


I  Characteristic 


HOUSEHOLDS  WITH  FEMALE 
HOUSEHOLDER,  NO  HUSBAND 
PRESENT,  WITH  RELATED 
CHILDREN  UNDER  18 

Total  

Recipiency  Status 

Vith  income  as  defined 

Vith  addition  or  deduction 

fylean  addrtion  or  deduction dollars. 

Standard  error dollars. 

Mean  total  income  dollars. 

Standard  error dollars. 

ncome  Levels 

Percent 

inder  55,000 

5.000  to  S9.999 

10,000  to  SI  4,999 

M5,000  to  SI 9,999 

■20,000  to  S24.999 

25,000  to  S29.999 

130,000  to  S34,999 

35,000  to  339,999 

40,000  to  S44,999 

■45,000  to  S49.999 

,  50,000  to  S59.999 

30,000  to  574,999 

75,000  to  599,999 

,100,000  and  over 

I  ummary  Measures 

edian  dollars . 

Standard  error dollars. 

ean dollars. 

Standard  error dollars . 

ini  ratio 

Standard  error 

fuintile  Measures 

t  qutntile: 

c  Upper  limit dollars. 

Percent  of  households 

With  type  of  addition  or  deduction 

Mean  amount dollars. 

Standard  error dollars. 

tf^tcondquintile: 

■Upper  limit dollars. 

Percent  of  households 

With  type  of  addition  or  deduction 

i         Mean  amount dollars. 

Standard  error dollars. 

ird  quintile: 

c^  Jpper  limit dollars. 

■Percent  of  households 

With  type  of  addition  or  deduction 

^       Mean  amount dollars . 

I  Standard  error dollars. 

I'urth  quintile: 

'  Jpper  limit dollars. 

^erceni  of  households 

With  type  of  addition  or  deduction 

Mean  amount dollars . 

Standard  error dollars. 

:h  quintile: 

•Percent  of  households 

With  type  of  deduction 

Mean  amount dollars. 

Standard  error dollars. 


Excluding 

capital 

gams 

(current 

official 

measure) 

1 


8  670 
(X) 
(X) 
(X) 
(X) 
(X) 


100.0 
10.8 
17.0 
14,8 
11.5 
9.0 
7.6 


409 

24  508 

466 


14  420 
41.3 
(X) 


42  012 
18.9 
(X) 
(X) 
(X) 


65  258 
10.6 
(X) 
(X) 
(X) 


8  670 
(X) 
(X) 
(X) 
(X) 
(X) 


16  600 

303 

21   504 

363 

.433 

.0134 


13  408 

40.6 

(X) 

(X) 

(X) 


35  288 
18.5 
(X) 
(X) 
(X) 


52  481 
10.9 
(X) 
(X) 
(X) 


18  039 

287 

22  365 


13  921 
37.3 
(X) 


Definition  1 

less 

government 

transfers 


100.0 
27.2 
10.4 
11.1 


15  584 

395 

21   349 


7  654 

330 

2  413 

6  513 


39  659 

21.7 

607 

5  789 

297 


capital 

gams 

(losses) 


5  590 
1  254 
59  529 
5  353 


15  651 
393 

21  774 
534 


Definition  3 

plus 

health 


supplements 

to  vkiage  or 

salary 

income 


7  653 
3  630 
3  327 


42  235 

21.7 

1   374 

3  080 


Definition  4 

less 

Socia 

Security 

payroll 

taxes 


7  653 
6  728 
1   683 


7  410 

33.1 

1   271 

272 


22  891 

295 

2  389 

1   035 


Federal 

income 

taxes 


100.0 
27.9 
10.3 
11.0 


15  400 

395 

20  210 


21   450 

29.0 

1   202 

682 


36  021 
21.5 
1  785 
1   706 


Fall  1997 


VALUATION  OF  NONCASH  BENEFITS 


Table  12.    Income  Distribution  Measures  by  Definition  of  Income:  1995-Con. 


(Numbers  in  thousands    Households  as  of  March  ol  the  following  year    For  meaning  of  sv 

mbols,  see  text 

After  taxes-con 

Definition  7 

less 

State 

income 

taxes 

Definition  8 

plus 

nonmeans- 

tested 

government 

cash 

transfers 

Definition  9 

plus 

medicare 

Definition  10 

plus 

regular-price 

school 

lunches 

Definition  1 1 

plus 

means-tested 

government 

cash 

transfers 

Definition  12 

plus 

medicaid 

Definition  1 
means-tested 

3  plus  other 
government— 

Definition  14 

plus 

net 

imputed 

relum 

on  equity 

home 

Characteristic 

Noncash 
transfers 

Noncash 

transfers 

less  medical 

programs 

8 

9 

10 

11 

12 

13 

14 

14a 

15 

HOUSEHOLDS  WITH  FEMALE 
HOUSEHOLDER,  NO  HUSBAND 
PRESENT,  WITH  RELATED 
CHILDREN  UNDER  18 

Total  

Recipiency  Status 

With  income  as  defined 

8  751 

7  660 
4   188 
1   015 
81 
30  900 
625 

100  0 
25  9 
90 
105 
11,3 
10,5 
8.6 
68 
48 
34 
2.6 
34 
1  7 
1  0 
7 

17  086 
357 

20  587 
386 
491 

.0125 

7  700 

30  6 

154 

68 

8 

21  354 
29  1 

1   292 

249 

9 

35  008 

22  9 

1   502 

660 

17 

54  274 

125 

894 

1    366 

44 

49 

346 

4  925 

900 

8  751 

7  944 

2  361 
5  536 

171 

24   111 

639 

100  0 
21.4 
100 
107 
11  8 
104 
8.7 
76 
49 
38 
30 
37 
20 
11 
7 

18  306 
342 

22  081 
390 
470 
0125 

13  785 
39.3 
874 

3  889 
158 

24  957 

25  0 

557 

5   117 

293 

37  682 

19.2 

483 

5  964 

387 

56  093 

11  4 

291 

7  988 

575 

50 

157 

10  337 

1   207 

8  751 

7  954 
531 
3  933 
150 
34  364 
1   724 

100  0 
21  3 
98 
10.6 
11  8 
106 
84 
77 
50 
36 
33 
38 
21 
1  2 
7 

18  527 
337 

22  319 
392 
470 
0125 

15  382 

42  7 

143 

1   467 

152 

26  564 

24.2 

99 

3  932 
256 

38  937 
176 
113 

4  624 
190 

56  986 

106 

94 

5  398 
376 

49 

82 

5  687 

444 

8  751 

7  966 

1   828 

80 

1 

37  830 
1   037 

100  0 
213 
99 
10.6 

11  8 
105 
84 
77 
5  1 
36 
33 
38 
2  1 
1  2 
7 

18  539 
336 

22  336 
392 
470 
0125 

15  384 

427 

177 

81 

4 

26  570 

24  1 

433 

76 

3 

38  950 
176 
580 

77 
2 

57  002 
106 
401 

1 

49 
236 
86 

8  751 

8  675 

2  964 

4  915 

102 

14  355 
398 

100.0 
102 
150 
127 
136 
111 
88 
78 
57 
37 
34 
39 
2  1 
1  3 
.7 

19  400 
312 

24  000 
381 
421 
0130 

15  855 
40  5 

2   104 

4  570 

95 

26  837 
25  8 
485 

5  629 
322 

39  096 

178 

229 

4  814 

439 

57   110 

108 

89 

8  353 

1    102 

5  1 
57 
(B) 
(B) 

8  751 

8  675 
2  476 
2  797 
81 
25  399 
799 

100  0 
100 
136 
120 
130 
122 
9  1 
81 
59 
4  1 
34 
4  1 
23 
14 
8 

20  569 
329 

24  792 
383 
413 
0128 

16  219 
38  8 
876 

1  433 

49 

27   195 
26  5 
830 

2  917 

92 

39  410 
182 
428 

3  847 
199 

57  330 
11  4 
220 

4  615 
388 

52 

123 

4  800 

832 

8  751 

8  739 
5  294 
2  659 
48 
19  893 
386 

1000 
35 
109 

14  8 

15  8 
134 
106 

78 
65 
4  4 
34 
43 
23 
1  5 
8 

21   786 
285 

26  400 
372 
367 

0129 

16  758 
356 

2  686 

3  154 

67 

27  429 
284 

1  572 

2  281 

83 

39  537 

188 

659 

1   951 

132 

67  363 

11  9 

308 

1   866 

216 

53 
69 

(B) 
B) 

8  751 

8  739 

2  709 

3  327 

86 

12  885 

980 

1000 
35 
112 
180 
160 
12.7 
10.0 
79 
56 
40 
30 
4  1 
2  1 
12 
7 

20  529 
299 

25  370 
366 
370 
0131 

14  816 

31  8 

648 

1   614 

63 

25  434 
30  4 

1  135 

2  962 

90 

37  948 
208 
529 

4  965 
236 

56  239 
11  8 
245 

4  843 
415 

52 
152 

5  224 
521 

8  751 

8  742 
3   139 

fylean  addition  or  deduction 

Standard  error 

fyiean  total  income  

Standard  error 

Income  Levels 

Percent 

,.  dollars.. 
..  dollars.. 
..  dollars.. 
..  dollars.. 

2  317 

125 

36  398 

683 

1000 
32 

$5  000  10  S9  999 

105 

SI  0,000  to  $14,999 

146 
154 

$20  000  to  $24  999 

132 

105 

73 

$35  000  to  $39  999 

73 

4  4 

35 

$50  000  to  $59  999 

4.8 

26 

18 

8 

Summary  Measures 

Median 

Standard  error 

Mean 

Standard  error 

..   dollars.. 
..  dollars.. 
..  dollars.. 
..  dollars.. 

22  360 
300 

27  231 
382 
368 

.0129 

Quintile  Measures 

Lowest  quintile 

Upper  limit  

Percent  of  households 

With  type  of  addition  or  deduction 

Mean  amount 

Standard  error 

Second  quintile 
Upper  limit 

..  dollars.. 

..  dollars,. 
..  dollars.. 

..  dollars.. 

17  933 

37.4 

559 

1   029 

172 

29  127 
28.1 

764 

Mean  amount 

Standard  error 

Third  quintile 
Upper  limit 

..  dollars.. 
. .  dollars.. 

. .  dollars. . 

1   518 
156 

41   760 
18  1 

843 

Standard  error 

Fourth  quintile 

Percent  of  households 

With  type  of  addition  or  deduction 

Mean  amount 

Standard  error 

Fifth  quinlile 

..  dollars.. 
..  dollars.. 

..  dollars.. 

..  dollars.. 
..  dollars.. 

2   185 
189 

60  300 

11,3 

650 

2  733 

256 

5  1 

323 

5  939 

787 

Mean  amount 

Standard  error 

. .  dollars.. 
..  dollars.. 

lASSIST  Quarterly 


VALUATION  OF  NONCASH  BENEFITS 


Fable  12.    Income  Distribution  IVIeasures  by  Definition  of  Income:  1995-Con. 

Numbers  in  thousands    Households  as  of  March  of  the  following  year.  For  meaning  of  symbols,  see  text) 


Definition  1  less  taxes 
plus  capital  gains  (losses) 


Definition  1 

less 

govemment 


capital 

gains 

(losses) 


Definition  3 

plus 

health 


supplements 

to  wage  or 

salary 

income 


Definition  4 

less 

Social 

Security 

payroll 

taxes 


Definition  5 

less 

Federal 

income 

taxes 


lOUSEHOLDS  WITH  MEMBERS  65 
YEARS  OLD  AND  OVER 


>ecipiency  Status 

'ith  income  as  defined 

ith  addition  or  deduction 

Mean  addition  or  deduction dollars. 

Standard  error dollars. 

Mean  total  income  dollars . 

Standard  error dollars . 


icome  Levels 

Percent 

nder  S5.000 

1,000  to  S9.999  . . . 
0.000  to$14,999. 
5,000  to  $19,999. 
'0,000  to  324,999. 
'5,000  to  $29,999. 
10.000  to  $34,999 . 
.5.000  to  $39,999. 
0,000  to  $44,999. 
5,000  10  $49,999. 
0.000  to  $59,999. 
0,000  to  $74,999. 
5,000  to  $99,999. 
00,000  and  over  . 


ummary  Measures 

Jdian dollars. 

Standard  error dollars. 

dollars. 

Standard  error dollars. 


Intlle  Measures 

/vest  quintile; 

Jpper  limit dollars. 

i^ercent  of  households 

With  type  of  addition  or  deduction 

Mean  amount dollars. 

Standard  error dollars . 


dollars. 


dollars. 


oond  quintile: 

Ipper  limit 

Percent  of  households 

With  type  of  addition  or  deduction 

^      Mean  amount dollars. 

Standard  error dollars. 

^d  quintile 

fpper  limit 

ercent  of  households 

With  type  of  addition  or  deduction 

Mean  amount dollars. 

Standard  error dollars. 

rth  quintile' 

pper  limit dollars. 

ercent  of  households 

With  type  of  addition  or  deduction 

Mean  amount dollars. 

Standard  error dollars. 

I  quintile 

Brcent  of  households 

With  type  of  deduction 

Mean  amount dollars. 

;         Standard  error dollars. 


23  592 
(X) 
(X) 
(X) 


20  503 
236 

30  934 
369 

,470 
.0087 


14  420 
340 
(X) 
(X) 
(X) 


23  592 
(X) 
(X) 
(X) 
(X) 
(X) 


19  959 
204 

27  745 

287 

436 

.0084 


13  408 
31  5 

(X) 


23  610 
264 
(X) 
(X) 
(X) 


35  288 
18.2 
(X) 
(X) 

(X) 


19  994 

206 

27  777 


35  397 

18.0 
(X) 
(X) 
(X) 


52  520 
126 
(X) 
(X) 
(X) 


20  124 
22  374 
11   414 


1000 
40.7 
12.6 


8  427 

226 

20  173 

365 

655 


22  950 

243 

5  478 

12  286 


2  649 

11   657 

206 


1   412 

12  728 

319 


483 
54  360 
2  051 


100.0 
40.7 
12.6 


8  447 

231 

21    101 


20  124 
4  251 
3   100 


20  124 
7  673 
2  225 


7  410 
47  9 

1  Oil 
290 


22  891 

24.5 
2  255 


100  0 
40  9 
13.2 


21   450 

248 

4  032 


fi19 

36  021 

I^S 

12.7 

757 

2  942 

916 

2  893 

19 
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Table  12     Income  Distribution  Measures  by  Definition  of  Income:  1995-Con. 

(Numbers  in  thousands    Households  as  ot  March  ol  the  tollowmg  year    For  meaning  ot  symbols,  see  text) 


Characteristic 


After  taxes— con 


Definition  7 

less 

State 

income 

taxes 


Definition  8 

plus 

nonmeans- 

lested 

government 


Definition  10 

plus 

regular-pnce 


Tieans-tested 

government 

cash 

transfers 


Definition  12 

plus 

medicaid 


Definition  13  plus  other 
means-tested  governmeni- 


Noncash 

transfers 

less  medical 

programs 


HOUSEHOLDS  WITH  MEMBERS  65 
YEARS  OLD  AND  OVER 

Total  

Recipiency  Status 

With  income  as  defined 

With  addition  Of  deduction 

Mean  addition  or  deduction dollars. 

Standard  error dollars. 

Mean  total  income  dollars. 

Standard  error dollars. 

Income  Levels 

Percent 

Under  S5,000 

$5,000  to  $9.999 

S10.000  to  514,999 

Si  5.000  to  Si 9.999 

S20.000  to  $24,999 

S25.000  to  $29,999 

$30,000  to  $34,999 

$35,000  to  $39,999 

$40,000  to  $44,999 

$45,000  to  $49,999 

$50,000  to  S59,999 

$60,000  to  $74,999 

$75,000  to  599,999 

$1 00,000  and  over 

Summary  Measures 

Median  dollars. 

Standard  error dollars. 

Mean dollars. 

Standard  error dollars. 

Gini  ratio 

Standard  error 

Ouintile  Measures 

Lowest  qumtile 

Upper  limit dollars . 

Percent  of  households 

With  type  of  addition  or  deduction 

Mean  amount dollars. 

Standard  error dollars. 

Second  quintile 

Upper  limit dollars. 

Percent  of  households 

With  type  of  addition  or  deduction 

Mean  amount dollars. 

Standard  error dollars . 

Third  quintile 

Upper  limit dollars . 

Percent  of  households 

With  type  of  addition  or  deduction 

Mean  amount dollars. 

Standard  error dollars . 

Fourth  quintile. 

Upper  limit dollars. 

Percent  ot  households 

With  type  of  addition  or  deduction 

Mean  amount dollars. 

Standard  error dollars. 

Fifth  quintile 

Percent  of  households 

With  type  of  deduction 

Mean  amount dollars. 

Standard  error dollars. 


20  126 
10  540 
1  559 


23  426 
22  030 
11  268 


24  957 

26  6 

6  051 

11  896 


56  093 

120 

2  618 

14  116 


23  501 

23  504 

20  707 

459 

5  063 

79 

27 

2 

34  904 

67  312 

313 

3  685 

25  556 
262 

32  448 
305 
420 


16  382 

27  0 

4  012 

2  005 


26  564 

24  7 

5  718 

4  637 


25  556 

25  828 

262 

258 

32  450 

32  752 

305 

304 

15  856 

275 

1  005 

3  012 


27  195 

24  2 

616 

1  965 


39  410 
206 
400 


126 

325 

3  565 

238 


23  626 
2  617 
1  491 


16  758 

28  8 

1  645 

1  622 


27  429 

23  8 

496 

1  223 


23  626 
20  748 
6  296 


20  206 

232 

28  498 


25  434 

24  8 

5  736 

5  927 


lASSIST  Quarterly 
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'  This  paper  is  largely  based  on  Weinberg  (1996)  and 
Gameretal.  (1997). 

-  The  history  of  income  questions  asked  on  the  Current 
Population  Survey  is  from  Welniak  (1990). 

'  The  fungible  approach  for  valuing  medical  coverage 
assigns  income  to  the  extent  that  having  the  insurance 
would  free  up  resources  that  would  have  been  spent  on 
medical  care.  The  estimated  fungible  value  depends  on 
family  income,  the  cost  of  food  and  housing  needs,  and  the 
market  value  of  the  medical  benefits.  If  family  income  is 
not  sufficient  to  cover  the  family's  basic  food  and  housing 
requirements,  the  fungible  value  methodology  treats 
Medicare  and  Medicaid  as  having  no  income  value.  If 
family  income  exceeds  the  cost  of  food  and  housing 
requirements,  the  fungible  value  of  Medicare  and  Medicaid 
is  equal  to  the  amount  which  exceeds  the  \'alue  assigned  for 
food  and  housing  requirements  (up  to  the  amount  of  the 
market  value  of  an  equivalent  insurance  policy  —  the  total 
cost  divided  by  the  number  of  participants  in  each  risk 
class). 

"■  These  tables  also  include  three  additional  variants 
(denoted  la.  lb,  and  14a). 

^  See  Fisher  ( 1992)  for  more  historical  detail  on  the 
development  of  the  poverty  thresholds. 

"  Also  critical  to  the  definition  of  poverty  is  whether  to  use 
an  absolute  or  relative  measure.  A  relative  measure  sets  the 
poverty  standard  at  a  fixed  fraction,  say  50  percent,  of  some 
measure  of  the  population's  well-being  such  as  median 
family  income.  Thus,  under  a  relative  poverty  measure, 
only  if  the  incomes  for  the  families  at  the  bottom  of  the 
income  distribution  improve  relative  to  the  rest  of  the 
distribution  would  poverty  decline.  The  alternate  method  of 
measuring  poverty  and  the  one  currently  in  use  in  the  U.S.. 
at  least  in  theory,  is  more  or  less  an  absolute  measure. 
When  constructing  an  absolute  measure,  one  attempts  to 
measure  the  minimal  consumption  levels  of  as  many  goods 
as  possible.  The  cost  of  that  consumption  bundle  is  then 
increased  to  account  for  necessary  goods  not  included  by 
use  of  a  "multiplier."  Orshansky  measured  only  the  cost  of 


a  minimally  adequate  diet.  Other  proposals  have  suggested 
adding  shelter,  clothing,  and  medical  care  to  the  list.  We 
restrict  the  discussion  here  to  absolute  measures;  most 
observers  expect  the  U.S.  poverty  concept  to  retain  this 
feature. 

'  Data  are  from  the  Compensation  and  Working  Conditions 
Branch,  U.S.  Bureau  of  Labor  Statistics.  The  1966 
percentage  is  not  strictly  comparable  to  the  1996  figure. 

^  Exceptions  are  wages  and  salaries  (we  suspect  that 
respondents  sometimes  report  net  instead  of  gross  earnings) 
and  workers'  compensation  (payments  for  injuries  on  the 
job.)  There  are  early  indications  that  changes  to  the  SIPP 
questionnaire  in  1996  have  ameliorated  these  problems. 

'  A  National  Academy  of  Sciences  panel  on  the  future  of 
the  SIPP  recommended  moving  toward  the  use  of  the  SIPP 
for  official  income  and  poverty  measurement  (Citro  and 
Kalton.  1993). 

'"  A  full  review  of  budget-based  approaches  is  in  Watts 
(1993). 

"  There  is  also  an  issue  about  whether  to  use  the  official 
CPI  or  an  experimental  CPI  created  to  correct  for 
inaccurate  measurement  of  housing  costs  in  the  official  CPI 
prior  to  1983.  The  next  CPI  market  basket  revision  is 
scheduled  for  1998. 

'-  This  section  drawn  from  Appendix  A  of  U.S.  Bureau  of 
the  Census,  1996a. 

"  In  general,  inventory  changes  are  considered  in 
determining  net  income  from  nonfarm  self-employment: 
replies  based  on  income  tax  returns  or  other  official  records 
do  reflect  inventory  changes.  However,  when  values  of 
inventory  changes  are  not  reported,  net  income  figures 
exclusive  of  inventory  changes  are  accepted.  The  value  of 
saleable  merchandise  consumed  by  the  proprietors  of  retail 
stores  is  not  included  as  part  of  net  income. 

'''  In  determining  farm  self-employment  incomes,  inventory 
changes  are  usually  considered  in  determining  net  income 
only  when  they  were  accounted  for  in  replies  based  on 
income  tax  returns  or  other  official  records  which  reflect 
inventory  changes:  otherwise,  inventory  changes  are  not 
taken  into  account. 

'^  Child  support  paid  and  other  inter-household  transfers 
should  theoretically  be  subtracted  from  income  to  avoid 
double  counting,  but  the  data  necessary  to  do  so  are  not 
collected. 


Theoretical  and  Technical  Solutions  for 
Preservation  of  Electronic  Records  in 

Finland 


Outsourcing  as  a  temporary  solution 

The  National  Archives  of  Finland  faced  a 
severe  problem  at  the  end  of  the  1980"s. 
Electronic  records  had  replaced  traditional 
paper  records  in  many  cases.  Though  the 
National  Archives  preferred  -  and  still 
prefers  -  paper  records  to  electronic  ones,  it 
was  impossible  to  generate  hard  copy 
records  from  electronic  records  in  all  cases. 


bv  Matti  Pulkkinen  ' 


The  reason  is  simple.  The  capacity  of  a  computer  enables  it 
to  handle  records  which  are  unmanageable  in  paper  or 
microfilm.  It  is  obvious  that  appraisal  can't  be  based  on  the 
physical  format  of  a  record,  but  on  the  information  the 
record  contains. 

Our  first  attempt  was  to  outsource  the  preservation  function 
to  in  the  main  computer  centre  of  Finland  in  1989. 
Information  was  stored  in  "traditional"  way,  by  1/2" 
magnetic  tape  in  mainframe  environment.  It  was,  without  a 
doubt,  a  safe  solution.  But  outsourcing  had  its  obvious 
disadvatanges,  too. 

Preservation  was  costly.  The  charge  was  50  FIM/reel  each 
month,  including  backup.  This  meant  that  the  cost  of 
preservation  was  calculated  in  a  different  way  for  electronic 
than  for  paper  records.  This  fact  had  an  influence  in 
appraisal  practices  whereby  preserving  data  was  considered 
as  "expensive"  while  paper  was  regarded  as  "cheap".  It 
meant  that  a  great  amount  of  electronic  records  was  not 
preserved  because  the  solution  was  considered  too 
expensive. 

Access  to  electronic  records  was  difficult.  It  was  costly  to 
load  a  tape  and  run  queries  in  a  mainframe.  Mainframe 
serves  well  as  a  multi-user  database  server,  but  it  is  too 
robust  a  tool  for  archived  material.  The  basic  problem  of 
archiving  data  is  to  provide  access  to  a  very  large  volume 
of  very  little  used  data.  Only  in  very  rare  cases  do  you  have 
more  than  one  simultaneous  user  for  the  same  file.  You 
don"t  need  to  worry  about  the  speed  of  transactions  -  so  you 
don't  need  a  mainframe. 

One  main  point  was  whether  it  was  wise  for  an  organisation 
to  outsource  its  key  functions.  It  was  clear,  that  the  use  of  a 
computer  centre  had  to  be  a  temporary  solution. 


Solutions  in  middle  of  an  economic  crisis 

In  the  beginning  of  the  1990's  the 
economy  of  Finland  suffered  a  major 
setback.  In  1991 ,  the  gross  domestic 
product  diininished  7,1%  and  continued  to 
diminish  until  1994.  Government 
consumption  expenditure  sank,  too. 


It  was  a  crisis.  For  the  National  Archives  it  wasn't  possible 
to  invest  in  a  tape  repository,  although  the  need  for  a 
preservation  system  of  its  own  became  evident.  It  was,  also 
impossible  to  have  more  personnel. 

That  made  us  think  about  what  we  actually  did  need. 

Who  should  be  able  to  preserver  more..  If  we  don't  have 
data,  then  nobody  asks  for  it,  and  we  may  think  that  nobody 
needs  data  archives.  This  circular  argument  was  sometimes 
made,  when  we  considered  our  task. 

Safety  is  a  major  problem 

Secondly,  we  should  do  it  in  a  safe  way.  Safety  means 
safety  in  every  respect,  and  it  means  both  safety  of  material 
and  safety  of  citizens,  too. 

When  we  think  of  the  long-term  preservation  of  a  record, 
we  must  take  into  account  the  ageing  of  the  material  and 
other  such  threats.  Also,  we  mustn't  forget  that  the  society 
tends  to  change  as  well. 

Let  us  take  an  example.  In  the  year  1897  a  protocol  of  the 
Overstyrelse  for  pressarendena  -  the  Supreme  office  of 
press  affairs  -  written  and  then  preserved.  It  is  there,  in  the 
repository  even  today.  In  one  hundred  years  it  has  'lived" 
through  a  coup  de  etat  in  1899,  a  general  strike  and  rioting 
in  1905,  abolition  of  Overstyrelse  for  pressarendena  and 
rioting  in  1917,  a  civil  war  in  1918  and  series  of 
bombardements  in  1939  -  1940  and  in  1941  -  1944.  It  has 
been  preserved  through  economic  crises  in  1973  -  74  and 
1992-94. 

If  we  think  of  the  permanent  preservation  of  electronic 
records,  we  must  accept,  that  the  future  is  uncertain.  We 
hope,  of  course,  that  the  next  century  is  happier  than 
current  one.  but  we  can"t  be  sure  of  it. 

In  the  preservation  of  electronic  records  you  always  need 
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some  manpower  and  supplies.  You  can't  just  forget  your 
disks  or  cassettes  in  a  repository.  There  is  a  risk,  because  a 
severe  economic  crisis  may  make  the  performance  of  your 
routine  duties  impossible.  If  you  run  out  of  money,  you 
may  loose  your  data. 

The  nature  of  an  electronic  record  makes  its  preservation 
during  a  severe  crisis  a  difficult  task.  If  we  think  of  threats 
like  a  hostile  occupation  or  a  totalitarian  coup  de  etat,  the 
main  benefits  of  electronic  records  -,  easy  access  and  rapid 
altering  -  become  threats.  The  horrors  of  Rwanda  were 
enabled  partially  by  misuse  of  census  records. . 

Safety  by  replication 

We  selected  a  file  in  logical  sense  as  the  object  of 
preservation.  A  physical  media  can't  be  preserved  readable 
long  term.  File  formats  and  physical  formats  become 
technically  obsolete.  A  record  is  a  semantically  coherent  set 
of  information,  a  semantical  entity,  and  not  a  physical  one. 
It  is,  however,  true  that  a  record  can't  exist  without  some 
physical  container  for  the  information.       As  a  corollary 
we  can  say,  that  you  can  use  different  types  of  containers 
for  a  record.    TTiis  means  in  practical  level  that  we  have 
freedom  to  use  any  media  we  want  to  preserver  a  record  as 
long  the  semantical  integrity  of  a  record  can  be  guaranteed. 

We  can  replicate  electronic  records.  Indeed  replication  is  a 
key  technique  in  our  concept  of  security.  We  always  use 
two  different  media  in  preservation.  We  take  a  master  copy 
in  DAT  and  a  backup  in  8  mm,  and  if  we  want,  a  CD  R- 
copy,  too.  DAT  copy  is  preserved  in  National  Archives, 
backup  in  high  security  deposit  in  another  place. 

The  choice  of  storage  media  was  dictated  by  the  lack  of 
money  -  we  couldn't  possibly  construct  a  traditional 
repository  for  1/2"  tape.  By  selecting  a  more  compact 
media,  we  lost  perhaps  some  of  proven  security  of 
traditional  1/2"  tape.  We  can  compensate  for  it  by  a  faster 
cycle  of  recopying  of  records  -  once  in  five  years.  For  data 
cassettes,  it  is  sufficient  to  use  a  safe,  secure  storage  vault 
as  a  repository.  It  is  difficult  to  gain  illegal  access  and  it 
will  keep  the  temperature  and  relative  humidity  on  a  stable 
level.  Inside  the  vault  the  data  cassettes  can  be  stored  in 
fireproof  cupboards  to  .secure  them  from  fire,  water  and 
magnetic  interference.  There  has  been,  alas,  a  difficulty 
with  our  use  of  cupboards.  Relative  humidity  has  been  too 
high,  probably  because  the  insulation  material  contained 
wasn't  perfectly  dry  before  we  started  to  use  them. 

However,  these  cupboards  are  easy  to  evacuate,  if 
necessary.  Changes  of  temperature  are  very  slow  inside  the 
cupboard,  and  we  can  transport  material  for  example  in  an 
open  lorry  in  wintertime. 

Downsizing  with  Unix 

As  a  computer  environment  we  use  IBM  RS/6(X)0  C20 
machines.  The  operating  system  is  AIX  4.  There  are  1/2" 


tape-,  QIC-,  8-mm  Exabyte-,  CD  R-  and  2  DAT  devices  in 
the  same  machine,  and  we  are  about  to  connect  a  3480- 
device  in  this  machine,  too.  For  security  reasons,  this 
machine  works  as  stand  alone,  but  we  can  temporarily 
connect  it  to  our  network,  if  we  want. 

Unix  has  been  an  optimal  platform  for  archival 
preservation.  It  contains  powerful  script  language,  c- 
compiler  (unfortunately  an  option  in  AIX  4)  and  all  the 
device  drivers  we  need.  AIX  is  easy  to  manage. 

You  can  do  a  lot  with  Unix  programs  like  cut  and  grep:  you 
don't  need  to  load  your  data  for  example  in  a  relational 
database  to  query  it. 

The  cost  of  investment  for  the  construction  of  the  vault  and 
the  purchase  of  storage  cupboards  and  computer  equipment 
is  the  equal  of  the  cost  of  outsourcing  the  electronic  records 
preservation  function  over  a  three-year  period. 

The  value  of  records 

The  values  that  inhere  in  basically  any  records  are  of  two 
kinds:  primary  values  for  the  originating  agency  itself  and 
secondary  values  for  other  agencies  and  private  users. 
Records  are,  of  course,  originally  created  to  fulfil  the  first 
of  these:  they  are  created  to  accomplish  those  purposes  for 
which  an  agency  has  been  created  -  administrative,  fiscal, 
legal  and  operating,  if  we  are  referring  to  public  records. 
But  in  archival  perspective,  more  important  is  the  second 
meaning  -  records  are,  after  all,  preserved  in  an  archival 
institution  because  they  have  values  that  will  exist  long 
after  they  cease  to  be  of  current  use.  and  because  their 
values  will  be  for  others  than  the  creators. 

These  secondary  values  of  records  can  be  furthermore 
divided  into  two  kinds: 

1.  The  evidence  they  contain,  i.e.  evidential  value, 
referring  to  the  value  that  depends  on  the  character  and 
importance  of  the  matter  evidenced. 

2.  The  information  that  they  contain,  i.e.  informational 
value,  which  may  relate,  in  a  general  way,  either  to 
persons,  or  things,  or  phenomena.  In  modern  archival 
science  the  evidential  value  is  regarded  as  the  principal 
value  of  a  record. 

There  has  been,  however,  little  or  no  discussion  about  the 
nature  of  these  two  values.  A  closer  study  of  both  these 
aspects  of  preservation  is  important,  and  especially  when 
we  are  discussing  the  preservation  of  electronic  records. 

Informational  value 

Tlie  semantics  of  informational  value  is  quite  clear.  We  can 
here  adopt  the  so  called  "the  naive  theory  of  truth"  on  the 
semantic  issue.  From  an  epistemological  point  of  view  this 
theory  in  itself  is  not  sufficient,  but  altogether  it  is  'good 


enough"  to  be  used  in  logic.  This  theory  of  truth  implies, 
that,  for  example,  the  sentence  "there  is  an  A"  is  true  only 
and  only  if  "A"  is  a  really  existing  entity.  If  there  is  no 
entity  called  "A"  in  the  world,  the  sentence  is  obviously 
untrue. 


So  we  can  state,  that  -  in  the  strict  sense  -  evidential  value 
is  lost  when  authenticity  or  integrity  is  lost.  Many 
preservation  programs  for  electronic  records  seem  to  be 
unaware  of  these  problems  mentioned,  and  to  which  should 
be  given  more  investigation. 


According  to  what  we  said  earlier,  we  can  conclude,  that 
when  any  record  includes  true  and  meaningful  statements, 
it  also  contains  informational  value.  So  if  a  record  states, 
that  there  exist  -  or  has  existed  in  the  time  that  record  in 
question  was  created  -  an  "A",  and  if  this  statement  is  true  - 
it  can  be  verified  to  be  true  -,  the  particular  record  in  hand 
contains  unquestionable  informational  value. 

Evidential  value  and  speech  act  theory 

We  can"t,  however,  adopt  this  theory  of  truth  used  above  to 
the  matter  of  the  evidential  value  of  a  record.  While  a 
receipt  can  be  genuine  or  not,  but  semantically  it  can"t  be 
said  to  be  either  true  or  untrue.  In  fact,  the  evidential  value 
is  always  bound  in  the  use  of  the  particular  record  -  the 
record  does  not  have  evidential  value  per  se. 
The  semantics  of  evidential  value  has  to  be  derived  from  so 
called  "speech  act  theory".  This  theory  states,  that  a 
performative  act  of  speech  is  neither  true  nor  untrue.  A 
more  coherent  way  to  make  the  distinction  is  to  use  the 
terms  successful  and  unsuccessful.  A  judge,  for  example, 
can  impose  a  penalty  on  a  criminal  in  the  court.  He  has  the 
authority  to  do  so.  In  this  context  his  sentence  "the  court 
fires  you  the  sum  of  1000  pounds"  is  successful,  when  and 
if  the  judge  follows  formalities  stated  by  the  law.  The  judge 
can"t  use  the  power  given  by  the  law  to  him  outside  of  the 
court.  So  his  sentence  of  punishment  will  be  unsuccessful 
when  imposed  outside  of  the  court. 

Some  conclusions 

We  can  now  argue  that  the  very  nature  of  evidential  value 
is  based  on  semantics  like  this.  It  implies  that  we  can  use 
binary  logic  as  a  tool  of  falsification  of  evidential  value.  If 
and  when  we  accept  the  argument  generally  shaped  in  this 
paper,  we  can  furthermore  define  some  formal  criteria  for 
the  evaluation  of  evidential  value. 

Some  essential  -  although  maybe  not  all  -  questions  of 
evidential  value  can  be  reduced  in  the  two  following 
concepts  of  authenticity  and  integrity. 

The  first  of  these,  the  problem  of  authenticity,  is  one  of  the 
key  problems  concerning  the  preservation  of  electronic 
records.  This  question  can"t  be  solved  with  those 
techniques  used  in  data  transfer.  For  example  public  key 
encryption  is  highly  software-bound  and  sometimes  also 
hardware-dependent.  In  archival  preservation  we  cannot 
and  we  should  not  rely  on  public  key  encryption 
techniques.  The  other  key  issue  in  preservation,  i.e. 
integrity,  can  also  be  easily  violated,  for  example  by 
loosing  referential  integrity  or  transactional  integrity. 


*  Paper  presented  at  lASSIST/IFDO  -97,  Odense,  Denmark, 
May  6-9,1997.  Matti  Pulkkinen.  KANSALLISARKISTO. 
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Tying  Everything  Together  with  a  Relational 

Database 


Rapid  change  in  delivery  method  means 
that  the  information  which  is  necessary  to 
access  data  is  also  changing  rapidly.  The 
density  at  which  a  tape  or  cartridge  was 
written  is  critical  information  for  reading 
the  data  on  it  while  if  the  data  is  online  the 
location  is  critical.  On  way  of  handling 
such  changes  in  required  information  is  to 
store  it  in  a  relational  database. 
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What  exactly  is  meant  by  a  relational  database?  Fully 
relational  databases,  satisfying  all  conditions  set  out  in 
Codd's  definition,  may  only  exist  in  theory  and  would  be 
more  than  needed  for  this  discussion.  Here  what  is 
required  is  first  that  there  be  some  degree  of  normalization 
of  the  data.  As  an  example  some  studies  have  only  one 
dataset  while  others  have  many,  a  record  that  tried  to 
anticipate  how  many  datasets  is  not  likely  to  be  very 
practical  so  put  the  study  information  in  a  study  record  and 
the  dataset  information  in  a  dataset  record  with  one  record 
for  each  dataset  and  a  key  to  the  study  record.  Then  it  is 
necessary  that  there  be  some  way  of  accessing  these 
records  together  so  that  it  looks  as  if  two  (or  more)  separate 
records  are  really  one.  Structured  Query  Language  (SQL) 
is  the  accepted  (complete  with  an  ISO  standard)  way  of 
doing  this  for  a  relational  database. 

Using  the  example  of  studies  and  datasets  in  a  simplified 
version,  let's  say  we  have  two  tables  which  is  the  accepted 
term  in  relation  databases  for  the  structure  in  which  the 
records,  called  rows,  are  stored.  The  first  table  is  called 
studies  and  has  fields,  columns  in  relational  terms, 
study_num  and  title  and  the  second  table  is  called  datasets 
and  has  the  columns  study_num,  dataset_num,  and  name. 
Now  a  very  simple  example  to  make  sure  we  are  all  on  the 
same  page.  You  would  like  to  have  a  list  of  all  study  titles 
and  the  names  of  the  datasets  for  each  study.  You  could 
issue  the  SQL  command 

select  studies . title, 
datasets . name 

from  studies,  titles 

where  studies . study_num 
=  datasets . study_num; 

This  will  give  you  a  list  of  study  titles  and  dataset  names 
which  the  title  repeated  for  each  dataset.  Since  you  did  not 


request  study_num  or  dataset_num  you 
will  not  get  them  back. 

The  experiences  being  talked  about  here 
used  Relational  Database  Management 
Systems.  These  applications  were  started 
under  Ingres  and  migrated  to  Oracle  when 
the  university  wide  choice  of  a  database 


system  made  the  switch.  When  dealing  just  with  data  some 
of  our  researchers  have  used  SQL  under  SAS.  The  focus 
here  is  not  on  the  specific  relational  database  but  rather  on 
the  concepts  so  specifics  should  be  taken  as  concrete 
examples  rather  than  the  only  way  of  doing  it. 

Although  querying  the  database  directly  using  SQL  is  an 
option  and  it  is  possible  to  use  SQL  scripts  in  place  of  some 
of  the  things  used  here  what  will  be  talked  about  are  Oracle 
Forms  applications  (developed  with  Oracle  Developer/ 
2000),  perl  scripts,  and  C  programs.  The  C  could  probably 
be  replaced  with  perl  but  it  was  a  very  ambitious 
undertaking  written  by  the  system  administrator.  When  a 
perl  script  has  to  interact  with  the  database  it  is  currently 
oraperl  which  is  perl4.  The  perl5  scripts  use  DBI/ 
DBD::Oracle  and  will  go  into  production  when  the  C 
application  has  been  successful  tested  out  against  a  more 
recent  version  of  Oracle. 

Because  they  are  probably  only  of  interest  to  show  the  wide 
range  of  uses  I  will  briefly  touch  on  the  UNIX 
administration  applications.  The  C  application  (using 
Pro*C  precompiler  to  interface  with  Oracle)  is  a  print 
accounting  program  that  keeps  track  of  printing  on  our 
UNIX  cluster  and  our  NT  network.  Users  are  given  an 
allotment  for  printing  each  semester  and  must  pay  for 
additional  printing.  At  the  end  of  each  semester  a 
reconciliation  is  done  from  a  cron  job  to  zero  out  any 
allocated  funds  not  used  and  put  in  the  next  semester's 
allotment.  The  cron  job  is  a  perl  script.  The  application  for 
providing  additional  funds  (user  paying,  refund  because  of 
bad  printing,  etc.)  is  a  Forms  application. 

The  other  administrative  application  is  for  keeping  track  of 
our  users.  Since  not  everyone  on  campus  can  have  an 
account  on  our  system  this  application  must  check  with 
another  database  on  campus  to  determine  if  a  person  is  in 
the  correct  department  and  has  the  correct  status  (no 
undergraduates).  This  is  accomplished  by  means  of  a 
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database  link.  I  don"t  know  terminology  for  other 
databases  but  with  Oracle  a  database  link  is  a  means  of 
accessing  a  table  in  another  Oracle  database  as  if  it  were  a 
table  in  the  local  database.  The  printing  is  related  to 
system  users  by  a  column  indicating  what  allocation  of 
print  funds  they  get. 

Data  access  is  a  bigger  issue  as  while  we  provide 
computing  to  a  limited  group  we  provide  data  to  the  entire 
university.  Since  we  require  the  use  without  an  account  on 
our  system  to  show  up  in  person  and  present  then  campus 
ID  we  originally  developed  applications  under  Ingres  that 
were  used  on  our  UNIX  system  in  character  mode  so  that 
calling  in  from  home  did  not  present  a  problem.  When  the 
applications  migrated  to  Oracle  and  developed  under 
Developer/2000,  we  found  that  it  didn't  make  sense  to 
develop  in  character  mode  any  longer.  Even  with  PPP 
when  people  called  in  from  home  they  were  still  using 
character  mode  as  the  campus  software  had  vt220 
emulation.  The  database  had  become  even  more  a  part  of 
the  application  under  UNIX  as  that  is  when  we  started 
putting  data  on  line  so  that  there  was  even  more 
information  that  we  were  keeping  track  of  although  the 
user  probably  used  less  of  it. 

When  we  designed  the  database  we  had  been  using  tapes 
and  cartridges  for  obtaining  the  data  and  at  first  the  data 
was  still  used  on  the  mainframe  where  the  access  was  via  a 
tape  job.  The  tables  included  one  for  tape  labels  which 
also  kept  track  of  the  tapes  that  were  used  for  backing  up 
accounts,  temporary  use,  blank  tapes  entered  into  the 
system  but  not  yet  used,  etc.  Another  table  contained  tape 
infomiation  such  as  the  density,  the  character  set,  and 
whether  the  tape  was  labeled.  At  first  glance  it  might 
appear  that  these  two  tables  are  each  one  row  per  table  but 
the  labels  table  has  text  which  could  require  more  than  one 
row.  Other  tables  are  for  the  individual  files  on  the  tape. 

When  we  started  putting  data  online  we  could  redesign  the 
tables  dealing  specifically  with  the  tapes  to  include  online 
information  or  use  the  fact  that  the  database  was  relational 
and  use  an  additional  table  for  the  online  information.  We 
choose  the  later  since  not  all  data  was  being  placed  online. 

Data  requests,  information  about  what  is  online,  and  the 
library  system  for  hard  copy  documentation  all  share 
tables  about  the  studies  as  well  as  having  their  own  tables. 
For  data  are  current  system  is  a  mixture  of  perl  scripts. 
Forms  applications,  and  even  some  cgi  scripts  for  web 
access  to  the  information.  The  web  access  takes  care  of 
the  university  wide  access  to  the  information.  People  on 
campus  but  outside  those  who  have  accounts  on  our 
system  still  have  to  present  an  ID  and  request  access  in 
person  but  now  they  know  if  the  data  are  on  campus.   If 
the  data  are  on  campus  they  are  able  to  get  some 
information  such  as  the  size  of  files  that  they  are  talking 
about  before  they  make  the  request  so  that  they  can  make 


sure  they  have  the  space.  We  still  get  people  who  only 
want  a  few  numbers,  often  a  statistic  that  they  would  have 
to  calculate  from  a  very  large  dataset.  thinking  that 
everything  will  fit  on  a  floppy  that  already  has  a  number  of 
files  on  it,  but  the  web  seems  to  have  found  users  who  are 
better  prepared  to  make  use  of  the  data  when  they  come 
over  to  request  access. 

The  heart  of  our  data  system  is  a  series  of  perl  scripts. 
When  new  data  are  received  information  is  entered  into  the 
database  about  the  study  and  dataset  numbers  and  the  type 
of  file  (data,  documentation,  program,  etc.).  This  is 
actually  a  Forms  application.  As  the  information  is 
entered  a  todo  file  is  written  with  information  from  this 
table  and  a  number  for  later  identifying  the  file  internally. 
Please  note  that  there  is  additional  information  entered 
form  a  master-detail  relation  in  the  form  and 
programmatical  ly . 

Perl  scripts  to  read  tapes/cartridges  or  process  files  which 
have  been  ftped  or  are  on  other  media  such  as  CD-ROM 
use  the  todo  files  to  determine  if  a  file  should  be  read  and 
do  the  processing.  The  todo  files  are  also  generated  for 
existing  tape/cartridge  files  to  be  put  online  and  moving 
some  files  but  not  all  from  a  CD-ROM  to  disk  so  the  issue 
of  whether  or  not  a  file  should  he  read  is  real.  When 
processing  is  complete  (some,  unfortunately,  is  still 
manual  checking)  a  file  is  written  with  information  that 
should  go  into  the  database  as  well  as  information  needed 
to  move  the  file  from  the  processing  area  to  where  it  is 
accessible  to  the  users. 

The  names  of  these  files  are  placed  in  another  file  that  is 
read  by  a  nightly  cron  job.  The  actual  moving  of  the  data 
and  recording  of  the  information  in  the  database  is  done  by 
this  script.  Some  of  the  other  things  done  by  the  script  are 
to  check  the  type  of  file,  find  out  from  the  database  where 
that  type  of  file  should  be  moved,  check  that  there  is 
enough  space  for  the  file,  if  need  be  and  there  is  one 
available  set  the  database  to  use  a  new  directory,  check 
that  there  is  not  currently  a  file  in  the  directory  with  that 
name,  and  send  e-mail  about  problems. 

The  library  application  is  able  to  tell  whether  we  have  any 
hard  copy  documentation  for  a  specific  study  and  wether  it 
is  on  hand  or  checked  out,  check  thing  out,  and  check  them 
back  in.  If  someone  already  has  a  copy  of  a  specific  piece 
of  documentation  checked  out  they  are  not  permitted  to 
check  out  a  second  copy  of  the  same  thing.  Also  if 
someone  has  overdue  documentation  checked  out  the 
application  will  say  what  is  overdue  and  no  further  check 
outs  are  permitted  for  that  indi\ idual  until  the  o\erdue 
documentation  is  returned  and  the  situation  cleared  is 
some  other  way. 

All  of  the  user  infomiation  for  requesting  data  and 
checking  out  documentation  is  the  same  table  so  that 
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changes  do  not  have  to  he  entered  in  multiple  locations.  As 
much  of  the  information  as  possible  is  look  up  information 
from  other  tables.  This  not  only  makes  the  entry  simplified 
but  it  also  makes  for  fewer  errors"  in  addition  to  avoiding 
typos  this  avoids  ambiguous  entries  such  as  "student". 

There  are  a  lot  of  relations  that  exist  in  the  services  that  we 
provide.  Using  a  database  allows  us  to  restrict  who  can  do 
what  at  what  time.  Using  a  relational  database  for  the 
necessary  information  has  made  for  greater  accuracy,  a 
simplification  of  things  since  once  we  have  entered  an 
individual  say  for  data  we  don't  have  to  do  turn  around  and 
enter  them  again  for  checking  out  the  documentation,  and 
the  ability  to  do  automate  some  of  the  work. 
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Emerging  Internet  Image  Archives 
Visualizing  Biological  Species  and  Medical 

Conditions 


This  paper  discusses  Internet  sites  which 

enable  the  user  to  see  images  of  plants, 

animals,  and  human  disease  conditions  on 

computer  monitors.  The  organization  of 

the  electronic  archives  at  these  sites 

commonly  mimics  bioscience  taxonomy. 

Among  the  entities  experimenting  with 

biological  images  for  the  Internet  are  ■■■■^^^^ 

international  and  government  science  agencies,  academic 

and  research  institutions,  businesses,  computer  labs, 

interest  groups,  and  innovative  individuals. 

Digital  visualization  for  the  Internet  is  driven  by  evolving 
technology  and  legacy  materials.  Most  images  presented 
are  raster  bit-mapped  files  in  the  Graphics  Interchange 
Format  (GIF,  extension:  .gif)  or  use  the  Joint  Photographic 
Experts  Group  compression  (JPEG/.jpg).  GIF  and  JPEG 
standards  are  incorporated  in  Hypertext  Mark-Up  Language 
(HTML)  and  in  software  for  viewing,  editing,  and  printing 
images.  Platfonns,  operating  systems,  and  graphics 
software  can  almost  universally  import  and  export  files  as 
GIF  and  JPEG  often  though  the  standard  for  transporting 
images  (TIFF)  between  formats.  Software  "plug-ins"  allow 
additional  image  file  formats  to  be  viewed. 

The  physical  source  media  for  the  electronic  images  of 
biological  subjects  include  specimen,  film  and  digital 
photographs,  slides,  prints,  drawings,  x-rays,    magnetic 
resonating  images,  electrocardiograms,  and  sonograms. 
Images  displayed  were  originally  digitized  in  dozens  of 
raster  and  vector  image  file  formats  native  to    proprietary 
equipment  and  software  used  to  capture,  scan,  or  edit 
electronic  images. 

Human  factors  figures  in  visualization.  Can  people 
recognize  the  subject  of  the  image?  Recognition  involves 
cognition,  culturally  detennined  perception,  cultural 
preferences  for  style,  and  the  visual  experience  and  training 
(technical  or  aesthetic)  of  the  viewer.  Composition  and 
clarity  critical  for  human  perception  may  be  affected  by  the 
view,  shape,  and  indication  of  scale,  details,  or  color  if 
critical  for  identification:  what  about  the  subject  is 
displayed.  Focus,  size,  tones,  background  or  context,  the 
placement  of  the  subject,  and  the  method  used  to  create  a 
digital  image  affect  human  perception:  how  technically  the 
image  is  made.  Images  with  high  resolution  can  convey 
finely  detailed  content  and  color  tone  gradients,  can  be 


magnified  (zoomed  up),  and  require  a 
higher  density  of  pixels:  the  differentiated 
bv  Leslie  A  Browiiriee  '  units  of  equal  size  that  inake  up  an 

electronic  image.  High  pixel  density 
implies  more  bytes  of  data  and  larger  files. 
Large  files  tax  the  capacity  of  Internet 
packet  transmission,  and  serving  and 
receiving  computers.  "Lossy"  principle 


compressions  (including  JPEG)  reduce  file  byte  size  by 
literally  "losing"  visual  bits,  degrading  images 
irretrievably.  Sizes  of  raster  files  posted  for  viewing  on  the 
Internet  to  depict  or  identify  biological  species  and  human 
disease  conditions  were  observed  to  range  from  around 
five  kilobytes  for  highly  compressed  photo  "thumbnails" 
and  black  and  white  line  drawings  to  hundreds  of  thousands 
of  kilobytes.  The  large  size  of  electronic  image  files  is  one 
reason  why  more  image  files  are  posted  for  downloading 
than  for  immediate  viewing  on  the  Internet.  File  size 
influences  the  commonly  made  decision  to  locate  image 
files  in  a  terminal  position,  at  the  end  of  an  archivein  an 
auxiliary  Computer  Graphics  Interface  (CGI)  bin  or  CD- 
ROM  that  exclusively  warehouses  image  files.  On  home 
pages  or  directories,  links  to  images  may  be  embedded  in 
items  of  an  inventory  list  of  subject  or  file  names,  or  brief 
descriptive  text,  or  lossy  previews.  ( i )  The  terminal  or 
attached  position  of  image  files  fortuitously  permits  linking 
them  to  and  from  documents  within  and  among  sites  on  a 
unique  file  address. 

If  directory  and  file  names  are  semantically  meaningful  in 
human  language,  then  their  content  can  be  found  more 
easily  by  Internet  search  engines  which  automatically 
check  directory  and  file  names.  Using  Latin  or  common 
names  to  label  the  directories  and  files  where  information 
or  images  about  a  species  are  located  sets  up  a  smooth 
interface  to  browsers.  Files  named  "CI/GIF/Birch.gif  "  and 
"flora/Asteraceae/  Launeas/L-aborenscens/ 
Laborescense.  1  .jpeg"  can  be  identified  as  images  from  their 
extensions,  .gif  and  .jpeg.  One  file  identifies  the  subject  of 
the  image  using  a  common  name,  birch,  while  the  other 
uses  a  scientific  name,  L.  aborcscense.  Each  Latin  Genus 
and  species  name  is  short  hand  metadata  for  a  unique 
taxon,  defined  and  characterized  in  biological  data  bases 
and  monographs.  Bioscience  ranks  life  forms —  Kingdom, 
Phylum,  Class,  Order,  Family,  Genus,  Species  (and  their 
subs  and  branches).  The  second  file  is  nested  in  a  cascade 
of  directory  names  which  mark  the  subject's  botanical 
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classification.  Several  Internet  sites  have  adapted  the 
taxonomic  levels  of  biological  classifications  as  a 
structure  for  their  archives  of  electronic  materials  about 
species,  materials  in  hierarchies.  Taxonomic  levels  that 
group  similar  life  forms  gave  a  jump  start  to  the  logical 
organization  of  elaborate  archives  of  biological  species. 

Several  Internet  enterprises  are  vying  to  construct 
taxonomies  or  phylogenic  lists  to  describe  and  compile  data 
for  all  the  living  species  on  earth —  or  in  a  large  region. 
Some  of  these  sites  incorporate  illustration.  Others  are 
choosing  technologies  incompatible  with  the  special 
requirements  of  image  files. 

The  organization  of  "The  Tree  of  Life:  A  Phylogenetic 
Navigation  Systems"  is  instructive.  Tree  of  Life  is  a 
federated  site  distributed  on  1 8  servers  in  three  countries 
and  is  linked  to  additional  servers  where  specialized  sites 
note  their  on-line  "place"  in  the  tree.  Tree's  "page"  on 
frogs  (Salientia)  resides  on  the  University  of  Texas  server 
along  with  "Herps  of  Texas."  Adding  a  refereed 
description  for  a  higher  order  "clade"  or  "terminal  taxon" 
to  the  Tree  is  facilitated  by  the  data  entry  program 
MacClade  which  can  read  from  and  to  the  widely  used 
Phylogenetic  Analysis  Using  Parsimony  (PAUP) 
taxonomic  program.    Each  basic  "page"  in  the  Tree  of  Life 
covering  a  taxon  or  more  generalized  life  form  is  illustrated 
with  scientific  line  drawings  and  compressed  photo  images. 
Some  images  hide  the  HTML  indices  to  clade  Latin  names 
by  which  Tree's  internal  web  crawler  navigates  among  its 
"pages."  Images  can  be  attached  or  linked  at  any  point  to 
Tree  documents  and  generated  from  Tree's  random  and 
searchable  internal  browser  facility.  Tree's  photographic 
images  range  from  1 1,000  to  328,000+  bytes  in  size  .(2) 
Tree's  is  a  collaborative  effort  among  entomologists  at  the 
the  universities  that  serve  and  host  this  federation.  Its 
content  is  best  developed  for  insects. 

UNESCO's  Man  and  the  Biosphere  (MAB),  national 
government  scientific  agencies,  and  research  or  academic 
institutions  also  initiated  on-line  sites  with  comprehensive 
ambitions.  In  a  complex  of  sites  sponsored  and  affiliated 
with  U.S.  government  agencies,  attempts  are  underway  to 
link  sites  and  to  standardize  meta-data  aspects  for  the 
inventory  and  description  of  biological  species.  Agencies 
in  three  cabinet-level  departments  of  the  United  States 
federal  government  and  collaborators  are  forging 
distributed  Internet  inventory  data  ba.ses.  Nexi  include  the 
US  Information  Center  for  the  Environment  (ICE), 
National  Biological  Information  Infrastructure  (NBII),  and 
"ITIS"-  the  Inter-agency  Taxonomic  Information 
System. (3)  Standards,  data  base  layouts,  and  "meta 
maker"  data  entry  programs  being  tested  emphasize 
location  and  text  data  and  cannot  accommodate  images.  (4) 
Images  on  the  sites  affiliated  with  this  complex  are  rare, 
and  tend  to  adorn  home  pages,  or  lie  in  ad  hoc  galleries,  or 
buried  in  menus.  (5) 


Bioscience  requires  at  least  one  "voucher  specimen"  be 
held  in  a  scientific  repository  such  as  a  botanic  garden, 
herbarium,  zoo,  museum,  university,  or  research 
organization  to  establish  and  reference  the  existence  and 
scientific  name  of  a  unique  species.  Many  Internet  sites 
experimenting  with  visualizing  originate  from  these 
institutions  that  collect  and  classify.  Some  sites  cling  to 
traditional  presentations  of  specimen,  showing  animals 
confined  in  aquaria  or  cages  or  dried  plants  laid  out  on 
conventional  herbarium  sheets  (6).  Others  deploy  new 
media  to  photograph  living  organisms  in  fields  and  forests 
(7)  or  through  the  microscope. 

Many  institutions  post  digital  peeks  into  their  formidable 
collections  (8)  and  label  images  as  copyright,  hesitant  to 
reveal  their  research  patrimony  absent  "pay  per  view"  or 
use  fees.  Proceeds  from  the  market  for  digital  visuals  can 
potentially  reimburse  the  high  costs  of  processing, 
archiving,  and  serving  image  files.  On-line  mechanisms 
include  limiting  access  (on  passwords)  to  subscribers, 
collecting  fees  to  view  or  to  download  files,  and  receiving  a 
payment  for  each  "hit"  to  the  site  as  use  royalties  from 
subscription  services  (9)  or  from  advertisers.  Commercial 
tie-ins  are  possible.  Several  sites  display  biological  visuals 
to  catalog  items  for  sale  and  businesses  sponsor  sites  and 
popular  federations  to  attract  customers.  Until  recently, 
one  herbarium's  Internet  presence  was  hosted  and 
sponsored  by  a  garden  supply  site.  Two  popular  sites 
posting  images  of  felines  were  sponsored  respectively  by  a 
pet  food  company  and  an  airline.    Access  to  the  bulk  of 
images  on-line  that  visualize  human  disease  conditions  is 
already  structured  primarily  through  subscription  services. 
Access  to  electronic  archives  of  medical  imaging  tends  to 
be  strictly  privatized  to  the  archive's  donor/users.  An  off- 
line market  for  digital  images  exists  in  CD-ROMs, 
software,  and  print  ads. 

Some  of  the  most  visually  and  technically  sophisticated 
sites  featuring  numerous  images  of  biological  species 
prepared  for  immediately  viewing  on  the  Internet  were 
designed  and  initiated  by  experimenting  individuals  and 
computer  teams.  Henriette  Kress  issues  directories  full  of 
image  files  depicting  plants,  parsimoniously  linking  each 
file  name  she  lists  directly  to  an  image  file.     Kress' 
botanical  site  served  from  Helsinki,  Finland  (10)  is  relayed 
by  "mirror"  sites  on  three  continents,  a  tribute  to  the  site's 
outstanding  content  and  popularity.  Tim  Knight  developed 
and  maintains  sites  dedicated  to  images  and  other  electronic 
media  to  depict  the  living  primates  and  designed  Internet 
sites  for  several  zoos  and  scientific  associations. ( 1 1 ) 
Knight's  sites  are  worth  "visiting"  for  their  design  and  the 
quality  and  economy  of  images.  A  computer  technology 
group  at  a  Texas  university  is  posting  images  of  crops  and 
wildlife.  (12)  The  Korean  Research  and  Development 
Information  Center's  BIOINFO  computer  imaging  project 
serves  2300-1-  optimized  animal  pictures  in  its  on-line 
archive  which  can  be  searched  using  English  vernacular 


names  in  the  Roman  alphabet  or  Korean  names  and  script. 
(13)  Independently,  the  designers  of  these  four  sites 
pioneered  similar  technical  solutions  to  problems  that 
Internet  visualization  projects  confront.  The  exact 
technology  (equipment,  software,  file  format,  and  post 
digitalizalion  editing)  they  used  differs.  In  common,  the 
four  sites  post  attractive  color  images  that  can  be 
magnified  at  least  once,  in  files  sized  in  the  modest  20-25(3 
kilobyte  range.  In  common,  the  four  sites  created  the 
digital  images  displayed  by  by  scanning  film  photographs 
or  slides.  They  select  among  their  own  and  contributed 
photographs  those  that  can  be  successfully  scanned  at  quite 
low  pixel  densities  (under  100  dots  per  inch),  a  technique 
that  limits  image  file  size  at  the  moment  of  digital  creation. 
Photographs  suitable  for  this  technical  approach  must  be  in- 
focus,  high  contrast,  high  content,  and  centered  on  the 
subject. 

It  is  striking  how  many  Internet  images  show  the  faces  of 
animals  and  flowers  of  plants,  suggesting  face  or  flower  are 
regarded  as  the  the  inost  recognizable  or  visually 
interesting  feature.  Images  posted  to  portray  biological 
species  are  not  standardized  as  to  perspective  or  view 
whether  the  organisin  is  large  or  microscopic. 

By  contrast,  medical  imaging  by  x-ray.  magnetic  resonance 
(MRIs),  and  other  devices  to  diagnose  or  monitor  patients" 
disease  conditions  have  strictly  standardized  views. 
Protocols  exist  for  positioning  subjects  in  relation  to  the 
image  capturing  device  to  achieve  the  correct  views. 
Resulting  images  require  a  specialized  training  to  interpret. 
A  principle  of  file  compression  can  be  applied  to  highly 
standardized  views  :  to  reduce  file  size  by  removing 
extraneous  features  located  in  predictable  areas  of  the 
image  rather  than  to  "loss"  randomized  pixels  throughout 
the  image.  Fixed  view  medical  images  (14)  can  be  stored 
without  the  extraneous  features,  and  templates  of  what 
typically  appears  in  the  removed  sections  can  be  reinserted 
to  "decompress"  the  image  for  viewing. 

Human  disease  conditions  are  not  registered  in  a  single 
universal  taxonomic  hierarchy  like  that  for  biological 
species.  There  is  less  consistency  in  approaches  to 
organizing    medical  images  on  the  Internet.  Each  disease 
considered  unique  will  be  identified  by  its  own  diagnostic 
code  and  by  vernacular  or  scientific  names.    Diseases  are 
grouped  into  areas  of  specialization  recognized  in  the 
medical  coinmunity,  that  is,  grouped  either  as  related  to  a 
particular  organ  or  system  of  the  body,  or  to  a  disease 
processes,  or  stage  in  the  life  cycle.  Thus,  medical  images 
cluster  on  sites  for  medical  specialities.  Images  of 
melanoma  skin  tumors  (15)  can  be  found  in  dermatology 
and  cancer  archives. 

Additional  organizing  principles  are  applied.  Medical 
images  on  the  Internet  (and  private  Intranets)  are 
sometimes  organized  in  archives  containing  a  single 


technological  type  of  medical  image  — just  CAT-scans, 
just  MRI,  although  from  different  institutions  and 
concerning  different  patients,  perhaps  because  interpreting 
each  type  of  image  is  still  another  medical  specialization. 
Medical  imaging  is  sometimes  grouped  across  types  by 
source  (hospital,  clinic,  practice)  and  an  identifier  like  date 
of  deposit.  Medical  images  are  organized  in  the  "case"  of 
one  patient,  either  walled  off  in  a  confidential  archive  or 
broadcast  as  a  didactic  history  in  one  of  the  commercial 
medical  teaching  and  reference  Internet  subscription 
services. 

Electronic  images  depicting  human  medical  conditions 
produced  daily  due  to  their  role  in  diagnosis  and  treatment 
are  lost  to  retrieval  and  research  when  buried  in 
incompatibly  indexed  and  organized  archives. 

General  observations  follow  relevant  to  sites  with  extensive 
on-line  archives  that  include  image  files.  Site  designs 
typically  redress  the  intrinsically  large  size  of  image  files 
by  applying  compressions  and  by  exercising  selectivity. 
Giving  computer  directories  and  files  names  that  have 
meaning  in  natural  language  makes  them  easier  to  search. 
Archives  organized  by  establishing  layered  classes  that 
generically  includes  every  particular  thing  in  its  class,  are 
easy  to  navigate. 

End  Notes  (Internet  addresses  of  sites): 

( 1 )  Examples  of  Image  to  Image  directories  are  Missouri 
Botanic  Garden 's  directory  at 

http://www.mobot.org/mobot/research/ 
gallery.lagallery2.html 

http://www.turtlebackzoo.org/tbz25.htm 

http://www.cbs.nl/temp/lmi/fl30()rnr.htm 

(2)  Tree  of  Life 's  format  Is  explained  at 
http://phylogeny.arizona.edu/tree/home.pages/  intro.html 
and  see 

http://phylogeny.arizona.edu  /tree/eukaryotes/animals/ 
chordata/osteostraci/osteostraci.gif 

hltp://phy  logeny.arizona.edu/tree/eukaryotes/animals/ 
chordata/Ichthyostegalia.gif 

http:  //phylogeny. arizona.edu/  tree/eukaryotcs  animals/ 
anthropoda/liexapoda/coleopteni/colerptera.html. 

I  J)  For  more  information  about  this   U.S.  government 
Internet  enterprise  see 
http://www.nbs.gov/  nbii 

hltp://trident.  ftc.nrcs.usda.gov/itis/ 

http://ice.ucdavis.edu/ 
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http://icc.ucdavis.edu/US_National_Park_Scrvicc/ 
NationaLPari<_Scrvice.htnil 

hltp://ice/aboul_NPS_databases.html 

hltp://  www.f.s.fed.us/ 

(4)  http:://www.itis.usda.gov.images/twbscr.gif 
http://www.nhs.gov/nhii/current.status.html 
hltp://www. fw.vt.edu/fishex/macsis. html 

(5)  http://www.nhs.gov/featurcs/photogallery 
http://www.itis.usda.gov/images/twbscr 

(6)  http://www.inbio.ac/cr/tipos/  herbario/Cgrayumii.jpg 

http://www.mpiz-koeln.mpg.de:80/~stueber/ross/potato/ 
sucrense_complete.jpg 

(7)  http://bluchen.ags.udel.edu/udgarden.html 

(8)  http://www.nfrcg.gov.htm 

http://www.nmhn. cgi-in/wdb/fish/catalog/query/ 
catgno==00334647 

(9)  http://niemhers.aol.com/zooweb/pictures 

(10)  http://sunsite.unc.edu/herbmed/pictures 

http://sunsitc.sut.ac.Jp/pub/acadmeic/medicinal/ 
altemative-healthcare/herbal-medicine/unc.edu 

(11)  http://www.selu.com/~bio/PrimateGallcry/primates/ 
species. html/index. html 

http://www.selu.com/~bio/ 

(12)  http://www.ics.tamu.edu/FLORA/  gallery.htm 
http://leviathan.taniu.edu:  7(J/ls/slides.ef/ 
http://straylight.tamu.edu/tamu/tracy/chklcon.html 
http://ranch.tamu.edu/rlem/ 

(13)  http://bioinfo.kordic.re.kr/animal/ 

( 14)  http://www.laurie.umdnj.edu/database/ 
CollectedApps.acgi$  ImageListJpeg?l  1843 

( 15)  See  the  Dermatology  Online  Atlas  from  the  Erlanger 
Image  Database 


http://ultaet/med/kli/dcrma/biblddb/diagnose/d  g_m.htm 

and  see  MD  Challenger  sample  photo: 
http://www.embbs.com/img/i()000()  12.jpg 

•  Paper  presented  at  lASSIST/IFDO  '97,  Odense,  Denmark, 
May  6-9,1997.  Leslie  A.  Brownrigg,  United  States  Bureau 
of  the  Census 


Information  that  Come  as  Images: 
Overview  of  Issues 


Abstract 

Increasingly  information  is  available  as 

images:  colour,  black  and  white  -  from 

satellites,  photography,  scanning  in  the 

biomedical  sciences  or  scanning  of  printed 

sources,  like  codebooks  accompanying 

numeric  data  and  historic  records.  These 

images  have  very  specific  computer  i^^^^^^^B 

formats  but  need  to  be  easily  embedded,  identified. 

searched,  transferred  and  browsed  or  reproduced  to  paper 

to  make  them  useful  as  information  carriers.  Principal 

media  for  distribution  and  access  are  CDROM  and  Internet. 

Briefly  formats,  standards  and  applications  are  discussed  to 

indicate  how  much  actual  progress  is  being  made  in  putting 

image  information  into  the  hands  of  researchers  and 

interested  users. 

For  the  last  five  years  and  not  only  in  the  social  sciences 
but  in  many  areas  of  research,  in  CD-ROM  and  Internet 
publishing  and  in  library  services,  information  is 
increasingly  available  as  images.  There  are  several  reasons 
for  this  increase: 

1.  more  applications  that  create  images  :  data 
visualisation,  analytic  mapping,  flow  charting  to 
represent  questionnaire  routing.  GIS  systems. 
convenient  document  delivery 

2.  more  applications  that  need  images  as  content 
matter:  computer  assisted  learning,  distance  learning, 
multimedia 

3.    increased  transformation  feasibility  from  other 
media  (like  printed  or  hand  written  sources)  to  images: 
including  image  enhancement  and  manipulation  to 
correct  imperfect  originals 

4.  new  types  of  hardware  that  can  produce  images: 
digitising  video  sources  .  digital  photocameras, 
digitising  to  images  in  biomedical  research  and  health 
care,  remote  sensing,  forensic  applications 

5.  new  possibilities  for  distribution  of  series  of 
images:  improving  Internet  transfer  capacity,  new 
multi-page  image  formats  that  fit  better  with  Internet 
client  -  server  approaches,  easy  creation  of  single  or 
small  series  of  CD-ROM's  that  can  hold  large  numbers 
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of  images    • 

6.      new  approaches  that  explore  the  next 
step  from  preservation  to  presentation  by 
bringing  images  into  structures  like 
SGML  and  HTML  designs  or  by  betting  on 
new  formats  like  PDF 


7.  better  availability  of  applications  that  -  also  in  the 
public  domain  -  view,  browse  series,  and  print  images, 
including  reproducing  to  colour  on  a  low  end  desktop 
with  colour  printing  ;  new  (PDF)  reader  software  that 
can  "search"  images  of  textual  information  with  help  of 
shadow  pages  that  hold  text  approximations  of  the 
original  after  "dirty  OCR" 

8.  recognition  of  images  as  another  electronic  source 
of  information  that  needs  appropriate  bibliographic 
description  and  identification 

In  summary:  more  and  different  types  of  information  are 
provided  as  images  and  at  the  same  time  there  has  been  a 
shift  in  emphasis  from  long  term  storage  with  exact 
replication  of  the  original  and  efficient  compression 
towards  giving  access  :  finding  ways  to  locate,  search, 
browse  and  navigate  the  information  content  of  images. 

In  particular  a  format  like  TIFF  represents  that  longer 
established  practice  of  preservation  :  it  handles  virtually 
any  image  original  -  level  of  detail,  colour  schemes 
(including  black  and  while)  and  the  like  -  has  different 
compression  choices  (including  a  lossy  one),  is  computer 
platform  independent,  is  recognised  as  a  standard  and  by 
consequence  a  format  of  choice  for  scanning  stations  and 
almost  any  application  that  one  way  or  the  other  converts, 
transfers,  shows,  does  OCR  or  reproduces  images  to  print. 
In  addition  to  long  term  storage  it  is  efficient  in  simple 
distribution:  like  FTP,  CD-ROM's  with  series  of  TIFF 
images  and  document  delivery  of  scanned  journals. 
Internet  and  TIFF  though  proved  difficult  to  match:  the 
format  has  the  multi-page  feature  but  this  allows  by  it  self 
only  a  linear  lorward  and  backward  browsing  and  TIFF 
cannot  be  transferred  to  Internet  client  software  with 
features  like  an  increasing  level  of  detail  or  with  "page  on 
demand"  .    Always  a  complete  (multi-page)  TIFF  with 
all  original  detail,  has  to  arrive  over  the  Net  before  the 
image  information  can  be  viewed  or  printed.    A  possibly 
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very  time  consuming  exercise. 

In  terms  of  file  formats  and  compression  schemes  did  the 
Internet  and  the  relatively  slow  speed  of  parts  of  the 
electronic  connection  between  user  and  provider,  sparse 
improvements  to  bring  down  transfer  time  :  JPEG  for 
example  reduces  original  image  file  size  drastically  -  but 
is  a  lossy  technique:  after  decompressing  there  are 
differences  w  ith  the  original  :  Progressive  JPEG  and 
Interleaved  GIF  are  Web  developments  that  help  transfer 
by  first  presenting  a  rough  impression  to  the  user  and 
gradually  completing  the  image.  - 

This  development  forces  archival  organisations  that  both 
have  to  preser\  e  an  image  collection  and  are  information 
provider  with  that  very  same  collection,  to  keep  their 
images  in  two  formats  and  face  a  dilemma.  A  preservation 
choice  should  be  TIFF,  probably  off-line  on  CD-ROM's. 
But  a  different  format  would  be  needed  to  suit  Internet 
presentation  and  electronic  publishing. 

Though  bringing  down  transfer  time  is  needed  where 
Internet  speed  is  not  ideal  ,  the  real  issue  of  access  is  a 
different  one: 

1.  finding  approaches  to  bring  images  into  a  structure 
together  with  other  information  that  can  have  arbitrary 
other  formats,  like  ASCII  text,  raw  data  files  or  even 
sound  samples  when  biological  research  has  habitat 
photos  of  birds  together  with  recordings  of  their  calls 
and  field  notes.  Such  a  structure  would  also  allow 
browsing  and  navigating  with  hyper-links  and  not  just 
linear  as  in  the  single  multi-page  image  file 

2.  finding  ways  to  examine  the  information 
contained  in  images:  scanned  text  can  have  a  rough 
searchable  real  text  duplicate  after  "dirty  OCR"  .  other 
images  (like  photographs  or  historical  sources)  can  have 
meta-data  attached  that  allow  for  searching  and  locating. 
This  meta-data  would  take  the  usual  form  of 
keywording,  applying  subject  classifications  or  standard 
bibliographic  reference. 

The  two  approaches  go  particularly  well  together  when 
they  complement  each  other :  access  to  an  image  collection 
or  single  image  after  searching  meta-data.  with  the  images 
subsequently  structured  in  a  way  that  puts  them  into 
context  with  other  available  information  and  permits  easy 
walk-abouts  and  retrieval. 

The  main  choices  to  realise  this  kind  of  access  seem  to  be 
the  following: 


For  structure: 

1.  SGML  and  HTML  as  SGML  applied  to  the  Internet 


Pro 's: 

-  both  meta-data  and  any  further  information  type 
besides  images,  can  be  brought  into  this  structure  and  at 
the  same  time  keep  their  own  specific  (technical) 
fomiat: 

-  it  has  hyper-linking; 

-  it  is  a  general  standard  with  good  availability  of 
software  to  code  into  this  structure  and  to  decode  it; 

Con  's: 

-  HTML  Web  browsers  which  are  themselves  in  the 
public  domain  may  need  additional  commercial  software 
to  view  and  manipulate  particular  image-formats  ;  this 
forces  the  provider  to  choose  a  format  that  is  either 
supported  natively  by  the  common  Web  browsers  or  for 
which  the  additionally  needed  image-viewer  comes  free; 

-  TTie  same  software  arguing  holds  for  SGML 

•  The  Data  Documentation  Initiative  is  an  SGML 
structure  initiative  that  explicitely  defines  the 
possibility  to  bring  needed  information  into  SGML  in 
wahtever  format  it  comes:  also  questionnaire  pages 
scanned  to  images  (URL:  http://www.icpsr.umich.edu/ 
DDl/  and  the  May  1 996  paper  by  K  Rasmussen 
"Convergence  of  Meta  Data.  The  Development  of 
Standards  for  Social  Science  Data"  (contact  the  author 
at  boye@get2net.dk). 

2.  PDF  with  its  additional  hyper-linking  and  annotation 
features 

Pro 's: 

-  public  domain  availability  of  PDF  reader  software; 

-  the  reader  software  has  all  navigating,  browsing, 
searching  and  image-viewing  together  in  one 
application  ; 

-  it  has  hyper-linking 

Con 's: 

-  the  structure  is  limited  to  images  and  text  information 
(no  raw  data  for  example)  that  both  first  have  to  loose 
their  original  format  and  have  to  be  imported  into  PDF 
with  commercial  software; 

-  while  HTML  and  SGML  know  many  applications  that 
decode  this  structure  and  explore  its  information 
content,  has  complete  PDF  with  mixed  image/text 
content,  searching  and  hyper-linking  only  the  (free) 
Adobe  reader  software  for  technical  access 

•  Adobe,  the  initiator  of  PDF,  can  be  found  at  URL: 
http://www.adobe.com/ 

•  "Internet  publishing  with  Acrobat"  by  G  Kent , 
published  by  Adobe  Press  (1996)  discusses  "..creating 
and  integrating  PDF  files  with  HTML  on  the  Internet .." 
and  marks  Adobe's  move  to  adapt  PDF  to  Internet 
presentation 

3.  A  SGML  and  Internet  -  HTML  approach  supported  by 
PDF.  where  PDF  only  holds  the  images  but  the  (free) 


Adobe  reader  software  brings  sophisticated  viewing  and 
manipulation  ,  certainly  after  the  recent  adaptation  of  PDF 
to  Internet  requirements  like  "image  on  request"  from  a 
multi-page  file. 

•  the  PSID  Internet  site  can  serve  as  an  example: 
URL:  htlp;//www. isr.umich.edu/src/psid/pdf.html  ll  has 
to  be  noted  that  contrary  to  the  above,  the  PSID  site  and 
many  other  providers  use  PDF  only  as  a  distribution 
format  or  document  delivery  mechanism,  which  was 
made  attractive  by  Adobe  putting  PDF  reader  (and 
printing)  software  in  the  public  domain.  None  of  the 
expanded  features  of  PDF  are  utilised. 

For  searching  information  hidden  in  images: 

1 .  Database  approaches 

Several  scenario's  exist: 

-  descriptive  information  is  indexed  and  searched,  with 
the  images  as  search  result; 

•  WAIS  makes  this  possible  for  the  Internet 
outcomes  of  "dirty  OCR"  on  images  from  scanned 

documentation,  are  indexed  and  searched;  a  further 
linking  scheme  has  to  connect  with  the  right  image 
free-text  indexing  and  searching,  where  the  retrieved 
text  has  graphic-annotation  links  to  images; 

•  ISYS  database  software  and  the  International 
Social  Survey  Program  CDROM  are  an  example.  URL: 
http://www.za.uni-koeln.de/data/en/issp/index.htm 

Pro 's  : 

-the  database  or  search  engine  approach  quickly  brings 

results,  like  any  indexed  free-text  search 

Con 's  : 

for  the  same  reason  is  precision  in  search  outcome  not 

always  high  ; 

additional  effort  is  needed  to  create  descriptive  and 

image  linking  information,  or  with  text  from  some 

source  available  at  least  the  links  to  images  (  like  in 

codebook  text  and  scanned  questionnaire  examples); 

2.  Subject  classifications  and  keywording 

•  The  CASS  Question  Bank  on  the  World  Wide  Web 
illustrates  this: 

-  URL:  http://kennedy.soc.surrey.ac.uk/qb/ 
Welcome.html 

-  It  has  in  fact  both  different  subject  trees  and  a  search 
engine. 

Pro 's  : 

a  very  precise  search  that  takes  time  when  browsing 
subject  trees  but  can  still  be  fast  when  assisted  by  a 
thesaurus  approach 


Con 's: 

Even  more  than  in  rough  free-text  indexing,  is  human 
effort  needed  to  apply  keywords  or  classify  each  set  of 
images  (like  a  questionnaire  in  the  CASS  example) 

?•.  Applying  the  commercial  Adobe  Acrobat  software 
possibilities  to  expand  the  PDF  format  with  searchable  text 
that  can  be  produced  with  internal  "dirty  OCR"  .  This 
search  is  linear  and  images  that  have  a  non-text  content 
would  obviously  need  other  Acrobat  means  to  pinpoint 
particular  images.:  annotations  and  hyper-linking.  The 
hyper-linking  to  relevant  images  within  the  single  PDF- 
file  can  interestingly  enough  be  realised  with  the  idea  of  a 
"clickable  map"  :  particular  clickable  areas  of  an  image, 
like  a  scanned  Table  of  Contents  or  an  overview  picture  of 
the  human  body,  can  be  hot-linked  to  where  further  image 
infonnation  starts.  This  can  create  a  very  intuitive 
guidance  in  searching. 

•  A  very  recent  CDROM  produced  by  the  German 
2^ntralarchiv  and  the  Dutch  Steinmetz  Archive  holding 
part  of  the  Eurobarometer  questionnaires  in  the  original 
languages,  uses  this  type  of  clickable  hyper-linking 

•  ICPSR  produces  CD-ROM's  that  have  the  search 
facility  in  PDF  after  internal  "dirty  OCR"  :  for  example 
the  CD()013  "Health  and  Weil-Being  of  Older  Adults" 
prepared  by  NACDA  (URL:  http:// 
www.icpsr.umich.edu/nacda)  This  way  both  the 
original  codebook  page  is  available  in  PDF  as  image  and 
for  searching  the  same  format  holds  a  text  equivalent 
where  possible. 

Pro 's  : 

-  creating  the  descriptive  information  to  search  on  is  part 
of  the  Adobe  software 

-  the  idea  of  "click  and  go" 

Con 's: 

-  the  search  is  slow  ; 

-  non-text  images  cannot  do  with  automated  "dirty 
OCR"  and  need  complicated,  manually  added  hyper- 
linking  and  annotations  ; 

-  clickable  links  need  human  effort  to  organise  and 
implement  ; 

-  the  extended  PDF  format  with  the  above  mentioned 
features,  probably  has  to  be  regarded  proprietary  and 
would  always  need  the  hitherto  free  Adobe  reader 
software 

Conclusion. 

The  newer,  extended  features  of  PDF  are  too  recent  to  have 
had  much  evaluation  .  Many  services  and  products  have 
been  realised  in  PDF  but  predominantly  as  carrier  for 
document  delivery  and  distribution  -  following  the  bringing 
in  the  public  domain  by  Adobe  of  the  PDF  reader  software. 

SGML  (HTML)  seems  to  offer  the  better,  more  general 
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structure  for  access,  which  structure  can  also  hold  the 
descriptive  information  ,  keywords  or  meta-data  that  a 
search  engine  could  take  for  indexing  to  help  locate 
particular  images.  HTML  Web  applications  have  brought 
considerable  illustration  of  giving  access  to  information  as 
images  but  not  in  any  complicated  way,  other  SGML 
examples  like  the  DDI  still  ha\e  to  make  their  point. 

This  overview  makes  a  distinction  between  preservation 
and  presentation  and  has  focused  on  the  latter.  It  is  an 
exciting  new  area  of  services,  still  open  ended  in  direction 
but  moving  forward  quickly. 

■  Paper  presented  at  lASSIST/IFDO  '97.  Odense.  Denmark. 
May  6-9.1997.  R  de  Vries.  Steinmetz  Archive,  Netherlands 
Email:  repke.de.vries@niwi.knaw.nl 

'  The  Netscape  Web  site  "Inline  Plug  Ins:  Image  Viewers" 
nevertheless  feature  several  TIFF  applications 

-   Also  the  PNG  image  format  is  an  interesting  new 
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Introduction 

Researchers  who  work  with  large  sequential  datasets  are 
often  limited  in  the  kinds  of  analytic  strategies  they  can  use 
because  of  the  sheer  size  of  the  data.  Automated 
techniques  for  analyzing  sequences  were  developed  in  the 
1960s  by  scientists  studying  DNA,  RNA,  and  proteins.   In  a 
classic  volume  on  sequence  analysis,  Sankofl'and  Kruskal 
(1983)  demonstrated  its  potential  application  for  subjects  as 
diverse  as  bird  songs  and  macromolecules.  In  other  work. 
Andrew  Abbott  developed  "Optimal  Matching"  for 
sequence  analysis  in  the  field  of  sociology. 

In  this  paper,  we  describe  a  technique  for  analyzing 
sequences  using  Regular  Expression  Matching  (REM). 
This  technique  allows  researchers  to  examine  patterns  in 
longitudinal  data  by  condensing  sequences  of  events  into 
smaller,  more  tractable  units.  We  also  briefly  discuss  the 
development  of  a  database  structure  that  facilitates  this  kind 
of  analysis. 

Although  all  sequence  analyses  compare  linear 
arrangements  of  symbols,  whether  in  human  behavior  or 
DNA,  they  differ  in  their  assumptions  about  what  makes 
two  sequences  similar  or  different.  Sequences  in  their 
original  form  often  contain  too  much  detail  for  useful 
comparison,  since  the  possible  permutations  of  occurrences 
can  be  limitless.    Therefore,  in  all  cases  researchers  must 
create  the  rules  that  define  sequence  similarity  for  their 
analyses. 

Methods  for  determining  sequence  similarity  are  often 
referred  to  as  sequence-matching  algorithms.  These 
algorithms  are  mathematical,  and  compare  sequences 
without  reference  to  the  semantic  or  theoretical  structures 
that  created  them.  When  using  such  methods,  researchers 
who  wish  to  place  their  analyses  in  an  appropriate  context 


must  carefully  define  what  events  represent 
the  phenomena  of  interest. 

The  technique  described  in  this  paper  was 
developed  as  an  alternative  to  existing 
algorithms  and  allows  researchers  to 
identify  sub-patterns  of  events  within 
sequences  at  the  start  of  their  analysis. 


based  on  theoretical  or  practical  considerations.  Because 
this  technique  operates  on  a  single  sequence  at  a  time,  it  is 
faster  than  processes  that  require  comparing  many 
sequences  to  one  another. 

The  Project 

To  illustrate  REM,  we  will  describe  how  we  used  it  to 
analyze  the  sequence  of  events  that  led  to  a  child's 
placement  into  foster  care  in  three  states:  Illinois, 
Michigan,  and  Missouri.  We  were  looking  for  systematic 
demographic  and  geographic  differences  among  children 
that  correlated  with  the  events  they  experienced  in  the  child 
welfare  system.    REM  was  developed  to  describe  and 
compare  the  pathways  the  children  took  through  this 
system.  The  data  were  derived  from  the  administrative  data 
systems  of  the  Illinois  Department  of  Children  and  Family 
Services,  the  Michigan  Family  Independence  Agency,  and 
the  Missouri  Department  of  Social  Services. 

Preliminary  Data  Processing 

We  received  two  data  extracts  from  each  state:  one 
covering  investigations  of  child  abuse  and  neglect  in  the 
Child  Protection  System  (CPS),  and  the  other,  services  such 
as  foster  care  to  children  in  the  Child  Welfare  System 
(CWS).' 

We  began  by  creating  a  project  database  for  each  state  with 
the  same  essential  structure.  Each  state's  database 
contained  tables  for  CPS  and  CWS  data  and  one  table  for 
demographic  infonnation  on  the  children.  Next,  we  created 
an  event  table  that  contained  all  of  the  administrative 
events  for  all  of  the  children  in  each  system.  We  then 
transformed  each  child's  events  into  a  sequence  variable  or 
"history."  Finally,  we  used  regular  expression  matching  to 
formulate  "careers"  by  reducing  the  history  sequences.  At 
each  step  in  the  process,  we  preserved  enough  information 
from  the  previous  step  to  retain  llexibility  in  the  subsequent 
steps.  As  the  categories  became  broader  at  each  step,  the 
comparability  of  the  data  across  states  increased. 
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Creating  the  Event  Table 

In  this  analysis  we  focused  on  four  key  administrative 
e\ents: 

(1)  indicated  investigation,  an  investigation  in  which 
credible  evidence  of  abuse/neglect  was  found. 

(2)  unfounded  investigation,  an  investigation  in  which 
no  credible  evidence  of  abuse/neglect  was  found, 

(3)  case  opening,  when  a  case  was  opened  for  child 
welfare  services,  and 

(4)  placement,  when  a  child  was  placed  in  a  foster  home 
or  institution. 


patterns  between  sequences  would  make  them  unsuitable 
for  analyses  in  their  present  form,  we  had  not  foreseen  the 
amount  of  variation  in  the  length  of  the  sequences.  For 
example,  examining  the  distribution  of  event  sequences 
revealed  that  many  children  experienced  only  one  event, 
while  others  experienced  up  to  fifty.  This  wide  variation  in 
length  made  it  difficult  to  make  meaningful  comparisons 
among  cases  and  suggested  that  we  needed  a  method  that 
would  not  rely  solely  on  whole-sequence  comparison. 
Therefore,  we  focused  our  attention  on  identifying  the  sub- 
patterns  which  we  had  observed  in  the  sequences. 


Table  1 ,  Exarr^jle  Event  and  Histor/  Code; 

Evenl  Code 

History 
Code 

Description 

0 

0 

Birth 

1 

1 

Indicated  In\«stip;9.tion 

3 

3 

Unfounded  Investigation 

9 
15 

9 
B 

Case  Opening 
Foster  Hoirje 

17 
23 

C 

C 

Hcepital  Health  Facility 

Depart  nient  of  Mental  Hea.lth  Institution 

6 

b 

Case  Cltsing 

IS 

D 

Home  of  Parent  (Ending  Placement) 

We  created  one  record  for  every  event  a  child  experienced 
in  either  the  CPS  or  the  CWS.  We  then  coded  every 
record  with  a  number  denoting  a  particular  event  type 
(See  "Event  Codes"  in  Table  1 ).  These  records  contained 
the  child's  ID,  an  event  date,  and  an  event  type  code  (See 
Table  2). 

Creating  the  Historj'  Sequences 

We  transformed  each  child's  event  records  into  a  single 
sequence  of  codes,  since  as  separate  records  the  table 
structure  was  not  appropriate  for  sequence  analysis.  To 
make  the  programming  and  its  interpretation  easier,  we 
used  only  single-character  codes  in  the  history  sequence. 
Although  each  history  code  represented  a  single  event,  a 
given  code  value  could  represent  more  than  one  type  of 
event  (See  History  Codes"  in  Table  I ). 

We  first  reviewed  a  frequency  distribution  of  the  history 
sequences  to  identify  the  most  common  sequences  and  to 
see  the  repetition  of  patterns  within  and  among  sequences. 
This  review  also  revealed  data  entry  errors  that  we  could 
correct  or  eliminate,  such  as  children  receiving  services 
before  their  birth  or  children  being  born  multiple  times. 

Although  we  had  anticipated  that  the  variation  in  the 


Table  2, 

Exftn:iple  Event  ]3at&  for  One  Child 

ID 

Event  Code 

Event  Date 

125 

0 

Febl3.  lt?78 

125 

3 

Dec  16, 1991 

125 

3 

Dec  17.,  1991 

125 

3 

Jan  5.,  1992 

125 

1 

Feb  2.,  1992 

125 

3 

Apr  21.,  1992 

125 

Q 

May  20, 1992 

125 

17 

May  20.,  1992 

125 

23 

}unl5..  1992 

125 

18 

Apr  17, 1993 

125 

6 

Julio.,  1993 

Creating  the  Career  Sequences 

One  goal  of  our  research  was  to  elucidate  the  connection 
between  CPS  investigations  and  a  child's  subsequent 
placement  in  foster  care.    We  had  three  initial  questions: 
( 1 )  What  sequences  of  investigations  never  resulted  in  a 
child  welfare  case  opening  and  placement?  (2)  What 


sequences  of  investigations  resulted  in  the  child's  first 
placement?  and  (3)  What  sequences  of  events  resulted  in 
the  cliild  entering  the  system  without  an  investigation? 

Because  of  our  extensive  work  with  the  Illinois  data  and 
our  contact  with  all  three  states  regarding  current  and  past 
practices  and  policies,  we  had  some  knowledge  of  what  the 
most  common  patterns  of  events  might  be. 

The  following  examples  illustrate  how  this  prior  knowledge 
provided  us  with  clues  about  what  patterns  to  focus  our 
attention  on: 

•  We  understood  that  the  number  of  investigations  a 
child  experienced  was  not  a  critical  factor  in  the 
caseworker's  decision  to  place  the  child  in  foster  care. 
We  knew  that  children  with  histories  composed  solely  of 
unfounded  investigations  were  almost  never  provided 
with  services,  despite  repeated  contact  with  the 
department.  Therefore,  we  believed  that  the  number  of 
indicated  investigations  would  predict  placement  better 
than  the  raw  number  of  investigations. 

•  We  knew  that,  in  one  state,  caseworkers  were 
reluctant  to  remove  children  from  their  homes  after  only 
one  indicated  investigation  unless  they  were  in  imminent 
danger.  TTius,  we  expected  that  a  child  with  one 
indicated  investigation  would  be  less  likely  to  be  placed 
into  foster  care  than  a  child  who  had  two  or  more 
indicated  investigations. 

•  In  all  three  states,  we  knew  it  was  possible  for 
children  to  experience  a  case  opening  and  placement 
without  an  investigation  of  abuse  or  neglect,  but  we  had 
no  infonnalion  on  the  frequency  of  such  occurrences. 

Our  prior  analyses  of  the  foster  care  data  indicated 
that  once  in  foster  care,  a  child  could  move  between 
placements  numerous  times  before  being  returned  home. 
Although  the  placements  could  be  of  different  types,  the 
child  was  still  living  away  from  his  or  her  parents.  As  a 
result,  we  chose  to  treat  a  series  of  placements  without  a 
return  home  as  one  career  event. 

Regular  Expression  Matching 

It  became  apparent  in  looking  at  the  sub-patterns  that  they 
could  be  represented  by  regular  expressions,  a  notation 
used  widely  in  the  computer  science  field  for  specifying 
and  matching  sequences.-  (See  Appendix.) 

We  created  a  file  listing  the  regular  expression  patterns  we 
had  decided  to  analyze  along  with  a  "career"  code  for  each 
pattern  which  is  shown  in  Table  4.  We  grouped  the 
patterns  in  passes  because  we  knew  that  certain  patterns 
occurred  only  at  the  very  beginning  of  the  history  and  we 
needed  to  control  the  generation  of  the  matching  program. 
The  first  pass  was  used  to  remove  any  events  that  occurred 


Table  3,  Exarrjjjle  Histoid  Record 

ID 

Histoiy  Sequence 

Ivb 

LLHjjlj'yCLDh 

before  a  child  was  born.  Since  we  were  especially 
interested  in  the  first  series  of  investigations,  we  created  a 
pass  that  only  matched  to  initial  investigation  sub- 
sequences. The  last  pass,  which  was  applied  repeatedly 
until  the  history  was  exhausted,  contained  all  of  the  sub- 
patterns  we  were  investigating.  From  this  pattern  file  we 
generated  a  series  of  programs  to  transform  the  data. 

We  u.sed  the  AWK  programming  language  for  both  our 
program  generator  and  the  matching  programs  themselves. 
An  AWK  program  is  composed  of  a  .series  of  pattern  and 
action  pairs.  It  automatically  reads  through  data  files  one 
line  at  a  time,  and  each  line  is  matched  against  the  patterns 
in  the  order  they  are  listed  in  the  program.  When  a  line 
contains  data  that  matches  one  of  the  patterns,  the  action 
associated  with  that  pattern  is  executed.  The  patterns  may 
contain  regular  expressions,  while  the  actions  are  written  in 
a  language  similar  to  the  C  programming  language. 

In  our  project,  the  program  generator  read  the  pattern  file 
containing  the  sub-patterns  of  interest  to  us  and  generated  a 
series  of  programs  that  used  those  regular  expression 
patterns  to  process  the  history  data.  Each  program  in  the 
series  corresponded  to  a  particular  pass  in  the  pattern  file. 
If  a  pattern  matched  to  the  beginning  of  a  history  sequence, 
the  matching  characters  were  removed  and  the  career  code 
for  that  pattern  was  appended  to  the  career  sequence.  The 
child's  id,  history,  and  career  were  then  passed  to  the  next 
program  for  the  next  pass.  The  final  program  passed  the 
data  back  to  itself  until  the  history  sequence  was  empty  or 
until  a  fixed  number  of  passes  had  been  run.  If  the  history 
sequence  was  completely  matched,  a  lower  case  'x'  was 
appended  to  the  career  to  indicate  completion.  An  upper 
case  "X'  was  appended  if  more  history  remained  after  the 
maximum  pass  limit  had  been  reached. 

Analyzing  the  Career  Sequences 

Since  our  analysis  was  limited  to  examining  the  sub- 
patterns  that  led  to  a  child's  first  placement,  we  did  not 
analyze  children's  entire  careers.  Instead,  we  only 
analyzed  the  first  four  career  events  after  a  child's  birth. 

Because  the  REM  approach  simply  reeoded  the  original 
history  sequences,  it  preserved  the  unit  of  analysis,  thus 
allowing  us  to  attach  explanatory  variables  such  as  year  of 
first  entry  into  the  system,  sex.  race,  and  region'.  Once  this 
information  was  stored  in  one  file,  we  aggregated  the  data 
by  creating  a  crosstabulation  which  contained  frequencies 
for  every  combination  of  the  career  sequences  and  the 
explanatory  variables.  These  files  were  relatively  small 
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Taliilii  4  Hktory  Siquetice  Suki-pattern-;  V'l/ntiEnm  Pfigular  Exfievvion-; 

?3.55 

1 

2 

Regidar 
Expression 

0 

3-13-ir 

Career 
Code 

a 
b 
A 

Ei/ent  Seijuei-ce  Etesciiption 

Aierie-;  of  event  befcire  tlie  birtiidatt; 

BirtKdate 

Qie  or  more  indurated  iiive^tigationj  iti  a 

«ne  > 

3-13" 

B 

Liie  indicated  mve;;tie;ation  in  a  jerie  > 

3f 

p 

A  ■:  e  fie  V  o  f  u  nf o  u  nd  e  d  1  n V  e  •;  ti  g  a  ti  0  n; 

3,4,  5,  6eiE. 

9 

D 

^_a:e  opening 

3*1[31]* 

E 

At  least  one  indicated  in're;tigation  in  a 
«rie? 

3f 

C 

A-;erie^;  of  unfounded  inve-jtigation; 

6 

F 

'Ca^e  cloang 

[A-Z][A-Z] 

+ 

G 

A  -je  rie  ■>  of  placement 

[A-Z] 

H 

Cne  placement 

(fewer  than  1.000  records)  allowing  us  to  import  them  into 
a  spreadsheet  program  for  final  analysis  and  presentation. 

Conclusion 

The  REM  technique  described  in  this  paper  departs  from 
more  common  pattern  matching  methods  in  that  it 
incorporates  theory  and  practice  into  the  actual  matching 
process.  Using  this  technique,  researchers  can  test  their 
assumptions  about  the  structure  of  a  sequence.  It  is  an 
iterative  technique  that  allows  the  analyst  to  explore 
patterns  in  the  data  and  to  compare  them  across  populations 
simply  and  quickly.  Because  the  process  of  developing  the 
career  file  is  split  into  several  steps  (i.e..  creating  the  event 
table,  creating  the  history  sequences,  and  pattern  matching), 
it  provides  many  opportunities  to  check  the  data  and  to 
ensure  that  the  processes  are  transforming  the  data 
correctly. 


REM  allows  the  researcher  to  take  a  very  large  dataset  and 
to  represent  it  in  a  much  smaller  form,  while  maintaining 
the  critical  details  of  event  order  and  sequence.  For 
example,  in  our  Illinois  database  we  began  with  an  event 
file  of  over  5  million  records.  Transforming  this  file  into 
history  sequences,  career  sequences,  and  finally  into  a 
crosstabulation,  decreased  the  size  of  the  file  by  a  factor  of 
5,000,  making  it  significantly  easier  to  work  with. 

The  REM  technique,  as  written  in  AWK.  can  save  the 
researcher  hours  of  processing  time,  in  large  part  due  to:  1 ) 
the  way  AWK  reads  data  files  (i.e..  it  automatically  reads  a 
file  one  record  at  a  time)  and  2)  the  minimal  programming 
it  requires.  Performing  the  same  analyses  using  a  statistical 
software  package  would  have  required  much  more 
extensive  programming  and  perhaps  more  important,  would 
have  restricted  the  kinds  of  questions  we  could  have  asked 
in  exploring  the  original  data. 


Table  5,  ExannpleC 

areer  Sequence  Output 

Output  Record 

ID 

History  Sequence 

Careei 

Before  ProcessuvE; 

125 

05:351 5QCCD6 

x'^.iter  Pass  1 

125 

ss-^mcc  Ub 

b 

x^^er  Pass  Z 

125 

yCCDh 

bB 

.yter  Pass  j 
After  Pass  4 
AAer  Pass  5 
After  Pass  b 

125 
125 
125 
125 

CC  D6 
6 

bBD 
bBDG 
bBDGF 
bBDGF:: 

Special  Characters  Used  in  Regular  Expressions: 

[    ] 

All]/  single  character 

Aiy  sins;le  character  listed  v.ntl-m-i  the  brackets 

+ 

AiT/  sequence  of  one  or  rrjore  of  the  precedirri;  si/irjluol 

■',- 

AiTi;'  sequence  of  zero  or  more  of  the  preceding  s^/rriiol 

1 

0 

OR  -  niitch  one  of  the  expressions  the  bar  separates 
Treat  the  character  in  the  parentheses  as  a  single  si/rrhol 

Future  Directions 

Clearly,  REM  has  a  much  wider  application  than  what  we 
have  illustrated  with  our  project.  Our  analysis  did  not 
utilize  REM  to  its  fullest  potential.  For  example,  instead  of 
analyzing  just  the  initial  sequence  of  sub-patterns,  REM 
could  be  used  to  analyze  full  careers.  We  could  run  a 
similar  process  against  the  career  sequences  to  further 
shrink  the  number  of  categories. 

Finally,  we  did  not  explore  the  sub-patterns  in  as  much 
detail  as  we  could  have.  For  example,  we  included  .specific 
placement  event  types  in  our  event  table  and  history 
sequences  but  did  not  treat  them  as  separate  types.  In  the 
future,  we  can  easily  compare  differences  in  children's 
histories  following  specific  types  of  substitute  care 
placements  (e.g.,  home  of  a  relative,  private  foster  home, 
group  home,  etc.)  based  on  this  project's  current  database. 

APPENDIX 

Regular  Expressions 

In  general,  a  character  in  an  AWK  regular  expression 
matches  itself  Some  characters  with  special  meanings  in 
our  pattern  file  are  listed  below  along  with  some  examples 
of  their  use.  See  the  references  for  more  details. 
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NOTES 

' .  Child  Protection  Systems:  in  Illinois,  the  Child  Abuse 
and  Neglect  Tracking  System:  in  Michigan,  the  Protective 
Services  Management  Information  System;  and  in 

Missouri,  the  Child  Abuse  and  Neglect 

Data  System. 


Child  Welfare  Services  Systems:  in 
Illinois,  the  Child  and  Youth  Centered 
Information  System:  in  Michigan,  the 
Children's  Services  Management 
Infomiation  System;  and  in  Missouri,  the 
Alternative  Care  Tracking  System. 

- .  Regular  expressions  (REs)  can 
recognize  patterns  which  are  left  linear. 
Patterns,  such  as  a  balanced  sequence  of 
parentheses,  cannot  be  recognized  by  REs 
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because  such  patterns  require  "going-hackwards"  or 
maintaining  information  outside  of  the  RE.  For  further 
information  see  Aho.  Kernighan.  and  Weinberger  1988  in 
the  references. 

' .  In  all  three  states  we  differentiated  the  major  urban  area 
from  the  balance  of  the  state. 

■  Paper  preseneted  at  the  lASSIST/IFDO  1997  Annual 
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